Managed Package

Level 1

  • Page:
    Defect Resolution

    Crucial defects are quickly repaired and (MP) made available as patch versions to affected subscribers. (TBD)

  • Page:
    Toggle Off

    Optional features promoted to GA or Beta in a release can be deployed in an activated or deactivated state and toggled on or off by the subscriber. (TBD)

  • Page:
    Feature Toggles

    (sf) Custom metadata feature toggles may be hidden from the subscriber and activated through the LMA. (TBD)

  • Page:
    Scalable Deployment

    When Direct Deployment is used, scale agents on a platform like AWS, so that many subscribers can be upgraded at once. (TBD)

  • Page:
    Health Check

    The packaging and business orgs continue to pass the Salesforce Security Health Check following each major release, with a score of 80% or above. New subscriber orgs are reviewed with the Salesforce Optimizer before launch. (TBD)

  • Page:
    Toggle Tests

    Validations are performed with all features toggled off, all features toggled on, and with only new features toggled on. (TBD)

  • Page:
    Validation

    The latest work increment, is examined at the close of each sprint, to determine whether the version is ready-for-primetime. For MPs, a milestone version is validated. For CSs, a full staging sandbox is validated. For MPs, patch versions are run through the same gauntlet as major versions. (TBD)

  • Page:
    Upgrade Preview TSO

    Install the new version into the Preview TSO, which generates production-like environments. (TBD)

  • Page:
    New Components

    Once the new increment is deployed, update the change log to list any new components (classes, fields, and so forth) being added to the version, by using a Javascript macro to scrape the package details page.

  • Page:
    Transient Branch

    To freeze the work increment being released, a temporary branch is created from develop, and a pull request created from the transient branch to packaging or production. (TBD)

  • Page:
    Dev TSO Template Refresh

    (sf) At the end of the sprint, a new development TSO templates is provisioned, in case it is needed for patch development. (TBD)

  • Page:
    CheckOnly After Merge

    (sf) On merge to develop, the updated develop branch is validated (checkOnly) with the packaging org or production branch. (TBD)

  • Page:
    Peer Review and Testing

    Peer developers review and test all changes before code and sample data is merged back to version control, following a test plan that is created for each issue in Confluence. (TBD)

  • Page:
    Context Help

    Help for this Page is extended for new tabs, updated as needed, and linked to Help Site. (TBD)

  • Page:
    Report Examples

    New reporting examples are included with new features, as appropriate, and distributed through Direct Deployment. (TBD)


Level 2 

  • Page:
    Hammer Tests

    (sf) Subscriber Apex tests are run periodically to detect any new failures.  (TBD)

  • Page:
    Sharpen the AX

    (sf) The AppExchange entry is updated to the latest version for each new GA major version, without concern of prompting a security review.  (TBD)

  • Page:
    Org Details Object

    (sf) To track additional detail about subscriber orgs, a custom object in the business org is linked to the LMA and the subscribers Account object. The org details aggregates the API applications installed for each subscriber, the instance, the my domain name, the production org ID, as well as the staging/preview sandbox IDs, and refresh history. Ideally, an automation posts an alert whenever a new org is added, to queue followup actions. (TBD)

  • Page:
    Rock Steady API

    (sf) Global components are stable with a low regression rate, including behaviors of Global Apex class methods and variables, Apex triggers, custom metadata, custom objects, fields, validations, and workflows. (TBD)

  • Page:
    Zero Step Tolerance

    (sf) Any upgrade steps are automated or optional and can be invoked by subscribers. (TBD)

  • Page:
    Rollout Tracking

    The progress being made on a major version rollout is tracked in a shared checklist and/or Agile board. (TBD)

  • Page:
    Version Issue Resolved

    The issue for the version is resolved in the New Version issue tracker and indicates its resolution status (failed certification, certified but not deployed, certified and deployed). (TBD)

  • Page:
    Version Certification

    Each new version is validated following a detailed checklist and exploratory test plan. If all checklist items pass, the version is certified for production use. Uncertified versions are deprecated. (TBD)

  • Page:
    Scope / Tests

    Validation includes both regression tests and feature acceptance tests, in automated and exploratory form. #TestLikeACustomerr (TBD)

  • Page:
    Jira Change Log in your Confluence Wiki

    Update the change log to list the issues for the new version. (May be done in GNG Baseline.)

  • Page:
    New Version Agile Board

    The version creation and validation process is tracked in a shared checklist and/or Agile board, and included in the issue tracker. (TBD)

  • Page:
    UI Regressions

    Selenium Nightwatch tests are included where appropriate to assure that the user interface will continue to work as expected. (TBD)

  • Page:
    Security Scan

    Common security issues are checked as part of peer review or static analysis (TBD)

  • Page:
    OctoDocs

    Other shared components are documented with Octopus. (TBD)

  • Page:
    Evergreen Help Site

    The Preview and GA help sites are updated within each sprint to cover new tasks, topics, and references meaningful to end-users.  (TBD)


Level 3

  • Page:
    Ready to Develop Checklist

    (Help text, error messages, sample data ...) (TBD)

  • Page:
    Sample Feature Data

    New features provide new sample data to use with new components when appropriate. (TBD)

  • Page:
    Extensibility First

    New changes are specified with extensibility for multiple subscribers in mind, including the mock customer. (TBD)

  • Page:
    Ideas Considered

    Subscribers Ideas play a strong role in steering the future roadmap, along with a strong internal vision of the product's future. (TBD)

  • Page:
    Ideas Solicited

    Subscribers are able to post feature enhancement requests ("Ideas") to a forum for peer and product management review. (TBD)

  • Page:
    Production Immune System

    Usage metrics and logs are continually scanned to detect statistically significant variations in error volume, creating a "production immune system". (TBD)

  • Page:
    Score Card

    A set of leading and lagging metrics are used to predict and then review the success of a CS project or MP major version and compared with actual results prior to the next event. (TBD)

  • Page:
    Root Cause Analysis

    To ensure the quality and improvement of our change management process, and to prevent previously discovered problems from recurring, we perform a root cause analysis (RCA), by asking five whys. (TBD)

  • Page:
    Defect KPI

    Defect reports and repairs are closely monitored and used as a key performance indicator. (TBD)

  • Page:
    Feature Auditing

    (sf) FeatureSetupAuditTrail for subscribers are aggregated as part of Push Metrics. (Needs to be considered in the context of the Feature Management pilot.) (TBD)

  • Page:
    Push Metrics

    Feature usage and adoption is automatically monitored and subscriber orgs push configuration settings, logs, and statistics back to the MP business org. For Salesforce, the metrics include data storage used, installed packages, and Lightning adoption. For Communities, metrics include license counts and Community logins. (TBD)

  • Page:
    Configuration Wizard

    New implementation setup is streamlined through use of a configuration wizard that collect and updates settings. (TBD)

  • Page:
    Feature Configuration Audit Trail

    Any change to feature configuration (including validation rules) is recorded in a supplemental audit trail log and made available as part of Push Metrics. (TBD)

  • Page:
    Upgrade Slot Select

    Subscribers can select their own upgrade slot within a window, or accept a default upgrade date. (TBD)

  • Page:
    Push Major Upgrades

    Queue automated deployments of new versions from build server o to individual subscribers or subscriber groups. On Force.com, Deploy Fom Hub queues deployments form the business org. (TBD)

Please submit feedback to the DreamOps Success Group http://dreamops.org/group.