Eight Methods that Improve Forecasting Accuracy


Forecasting best practices for varying supply chain scenarios

Of all business factors, accurate forecasts have the greatest impact on an organization’s ability to satisfy customers and manage resources cost effectively. A forecast is not simply a projection of future business; it is a request for product and resources that ultimately impacts almost every business decision the company makes across sales, finance, production management, logistics and marketing.

Typically, a variety of forecasting methods are applicable to any particular type of supply chain scenario. Smart supply chain planners use multiple methods tuned to perform well at different phases of the product life cycle, chosen to best exploit the available historical data and degree of market knowledge. The key is to pick the most effective and flexible models, blend their best features, and shift between them as needed to keep forecast accuracy at its peak.

In this paper we will take a brief look at eight methods that have produced superior results in a variety of industries and market conditions around the world.

 

Three Categories of Forecasting Models 

Forecasting models classically fall into three categories: qualitative, quantitative and hybrid. The primary differences between them include the type of input data and the mathematical and statistical methods employed to generate forecasts.

Qualitative models are experience-driven, relying on subjective inputs from knowledgeable personnel, such as salespeople, account managers, and the like. This approach typically sets up formal procedures for data review, and requires a consensus to determine the value of various forms of information. Consensus among forecasters may be obtained by aggregating individual estimates or through structured polling methods.

Quantitative models are statistically driven, drawing heavily on historical performance data as the basic data input. The calculating logic is defined and operations are purely mathematical.

Time series models employ a time-ordered sequence of observations of a particular variable, and use only the history of that variable to determine future values. For example, if monthly sales volumes of lawnmowers sold in the Southeast United States display a linear pattern, a linear trend model would provide the best basis for the forecast.

Derived models create new forecasts based on existing forecasts. When a new item’s forecast is thought to be fundamentally the same as an existing item, characteristics can be used in creating the new forecast, which may be factored up or down by a percentage. This preserves the overall trend and seasonal characteristics of the item, providing a good starting point for the new item.

Hybrid models typically draw on historical demand information as a starting point, then use empirical data to further refine the forecast.

Attribute-based models employ user-defined attributes to model new product introductions, seasonal or fashion driven products, and product end-of-life retirement based on a demand profile.

Causal models use a causal relationship between a particular time series variable and other time series factors to calculate the forecast. Causal techniques are useful in forecasting ‘lift’ during promotional campaigns, where demand caused by promotional factors has an established relationship to base demand. Additional factors can be used, such as end-cap displays, seasonality of the product, etc. Factors are not additive but are used together to calculate the expected lift for your product.

 

Eight Forecasting Methods that Improve Supply Chain Performance

For many supply chain scenarios, it’s typically best to employ a variety of methods to obtain optimal forecasts. Ideally, managers should take advantage of several different methods and build them into the foundation of the forecast.

The best practice is to use automated method switching to accommodate selection and deployment of the most appropriate forecast method for optimal results. In order to ensure optimal demand forecasting, managers must employ the forecasting methods that best serve the unique dynamics of their business at a specific moment in time.

Advanced demand planning and forecasting systems automate many of the functions required to select, model and generate multi-echelon forecasts, lifting the burden of manually intensive approaches and accelerating sensitivity to model changes as market conditions evolve. A best practices approach also must include the ability to incorporate personal expertise and weight the various factors in generating forecasts.

In our experience working with more than 1,200 organizations ranging across dozens of industries, eight specific forecasting methods stand out. Their unique strengths combine to deliver powerful, flexible and accurate results.

Modified Holt is a best-fit statistical technique used when demand is trended, but does not vary by the time of the year. The Holt-Winters variant is used when demand is often higher or lower during particular times of the year.

Moving Average is used for products whose demand histories have random variations, including no seasonality or trend, or a fairly flat demand.

Inhibited is a type of derived model used to produce a zero forecast.

Modified Parent-Child is a derived model technique used to forecast products as a percent of the forecast for another product (dependent demand).

Modified Croston is an intermittent demand technique used for products such as slow-moving parts that have low demand or some zero demand periods.

The Demand Profile technique is attribute based. It employs user-defined attributes to model new product introductions and product end-of-life retirement.

Proportional Profiling is another attribute-based technique used to disaggregate higher-level forecasts into lower-level forecasts using user-defined attributes.

The Promotions/Events technique, based on causal modeling, calculates “lift” from promotions in addition to the normal forecast.

 

Best-fit Statistical Modeling

For most levels of management within an organization, aggregated demand history for product family, brand category, country and/or selling region are good predictors of future performance. Such demand history also serves as a baseline for effectively forecasting Stock Keeping Units (SKUs). When there are more than four-to-six periods of sales history, SKUs can be effectively forecast with moving average and basic trend methods. SKUs with at least one year of sales history offer sufficient information to incorporate a seasonal profile into the projected trend.

A modified Holt-Winters decomposition model with best-fit analysis can generate forecasts based on demand history that incorporate trends and seasonal information. The method “senses” the amount of history available for each time series or segment to create a basic model that best fits the history. Then it uses the best combination of smoothing factors to enable the model to react to changing conditions going forward without overreacting to anomalies in demand (such as unplanned seasonal events, transportation disruptions, and so on).

For factors relating to seasonality, planners need the ability to weight the historical demand. Under the assumption that the previous year is the best indicator of what will happen next year, most forecast systems apply a higher weighting factor to the previous year’s demand, less to the year before and even less to the years before that. But if the previous year was unusual in any significant way, the planner must have the capability to change the historical weighting factors (so that the history two years ago has more impact on the current forecast than last year, for instance) so as not to under- or over-forecast the business.

Seasonal methods can be effective with less than 24 months of history; the minimum required is twelve months. An effective approach for expected seasonal items with less than twelve months of history is to assign a seasonal curve that has been captured from a similar item or item group.

A powerful best-fit statistical method should include flexible features such as trend, seasonal-with-trend, moving average and low-level pattern fitting, as well as trend models for products with sporadic, low-volume demand. The method should provide limiting and damping, as well as seasonal smoothing, demand filtering, reasonability tests, tracking signals and tests for erratic nature that evaluate the validity of each element, determining which are anomalous and should be filtered. These parameters give the planner the flexibility to tune the process to best fit conditions at any element of the organization.


Log - 8A.PNG


“Best fit” refers to the ability to change forecast methods as a product evolves. The process may start out as a demand profile method, evolve to a modified Holt-Winters method as the product becomes stable, and ultimately transition to a demand profile method again as the product life cycle comes to an end.

 

Derived Modeling

One method of generating new product forecasts is to use demand variations or extensions from existing products, families or brands. Consequently, they draw on the historical data of existing products or families. When combined with causal effects or management-selected overrides to accommodate introductory promotions, derived modeling can provide a realistic and dynamic forecast for new products.

Using this approach, new products are assigned a percentage of the parent, family and/or brand, enabling them to proportionately inherit a forecast that contains the base, trend and seasonal elements of the associated category. As the forecast for the associated category is adjusted to reflect changing conditions over time, so too is the derived product’s forecast. If the derived product’s point-of-sale (POS) or demand levels deviate from the forecast and exceed a user-defined tolerance, the system can generate a performance management alert to notify forecast analysts to take corrective action.

Once the product has accumulated sufficient demand history of its own, the link to the derived model’s source model is severed and the product is then forecasted on its own using multiple best-fit statistical methods.

 

Modeling for Intermittent Demand

Slow-moving parts typically exhibit irregular demand that may include periods of zero or excessively lumpy demand. A Modified Croston Method handles low and lumpy demand that exhibits either a patterned variation or no pattern.

The patterned variation looks at available history and classifies each demand element relative to those around it. It classifies the periods into peaks, valleys, plains, plateaus, up-slopes and down-slopes. It measures the duration of plateaus and plains, as well as the severity of peaks and valleys. It then conducts pattern-fitting analysis to find regularity over time, attempting to fit the pattern to the history and averaging for low and high points. The patterned forecast is put in context of future periods with the average trend, and the pattern is re-evaluated using demand history of subsequent periods.

If no pattern is present, the unpatterned variation method attempts to use averaged highs and lows to create a step-change forecast for future demand.

Both techniques permit zero demand to reside in the history, and will acknowledge such in the future demand forecast. In forecasting for spare parts, for example, the demand is frequently low-level and spotty, containing many periods of zero demand interspersed with low-level demand. This forecasting technique allows patterns of zero demand to be forecast into the future.

 

Attribute-based Modeling

What if lack of data, short-life cycle or other mitigating factors make it difficult to forecast using time series or qualitative techniques? Forecast creation for new product introductions, short-life or seasonal products, and end-of-life products calls for attribute-based modeling techniques.

The attribute-based model provides a wide variety of demand profiles by which to characterize the product, and can adjust the product’s plan dynamically in response to early demand signals. The method will analyze historical sell-in and/or sell-through data to develop a wide variety of demand and seasonal profiles. These profiles are assigned to individual planning records. Then, as actual demand information is captured, the current profile is validated or alternate profiles identified to dynamically adjust the product’s plan.

Attribute-based modeling consists of four unique processes.

Creation of Demand Profiles. Demand profile creation is based on mathematical concepts known as Chi-squared analysis. The demand planner selects products to be included based on attributes such as colour, fabric type, region of the country, etc., and multiple attributes can be used at once. Planners can efficiently realign history for events like Easter, which does not occur during the same period each year.

Assigning Demand Profiles. New, seasonal and end-of-life products can now be assigned to Demand Profiles. Advanced attribute-based models offer ‘user-defined attribute’ matching capabilities, allowing the planner to set criteria for how a new product’s attributes must match the attributes of a demand profile.

Automatic Revision of the Forecast Based on Demand Signals. Forecast accuracy must be monitored continually using data such as Point-of-Sale (POS) to accurately monitor customer buying patterns. Other demand signals such as syndicated data is used to check the accuracy of the forecast. Correctness-of-fit modeling adjusts the forecast to reflect and quickly react to real-world changes.

Assess Accuracy of Demand Profile Based on Demand Signals. New products never sell exactly the same way as other products with similar attributes. But by using point-of-sale or other demand signals, the accuracy of the assigned curve can be checked against other demand profiles that have similar attributes. Relative-Error- Index (REI) calculations quickly show planners which demand profile has the most accurate fit based on current demand trends. The current demand profile can be switched to the profile that has the lowest REI.

 

Promotions and Causal Event Modeling

Causal modeling can specifically address the effects of promotional elements such as price discounts, coupons, advertising and product placements. It supports input from multiple marketing groups, and aids the identification and reconciliation of potential conflicts or overlaps in promotional planning proposals.

Causal modeling enables planners to quickly simulate marketing program options and refine forecasts. Using pre-trained neural network technology in causal-based modeling is a unique best practice that lets planners quickly start to model the cause-and-effect relationship of different promotional elements.

“Backcasting” is a technique in which past promotional events are entered into the neural network, which then learns the relationship of various elements. The pre-trained network takes on customized characteristics and behaviors quickly, rather than requiring 12—18 months to build from scratch. Using pre-trained neural network technology, planners can incorporate marketing activities into supply chain forecasts much more quickly.


Conclusion

Supply chain organizations routinely rank demand planning immaturity as a major obstacle in meeting their supply chain goals. Accurate forecasts are the foundation for profitable business growth. Optimal demand planning and forecasting requires comprehensive modeling capabilities plus the flexibility and ease-of-use to shift methods as life cycles progress and market conditions change.

Attribute-based methods that use demand profiles are often suited to new product introduction and end of product life cycles, at times when reliable historical demand data is lacking or the available data is less relevant.

At the more mature stages of the product life cycle, five different time-series statistical models come into play, including modified Holt, Holt-Winters, moving average, and intermittent or low demand, whether patterned or unpatterned. These models are used to create retrospective forecasts that cover prior periods (typically three years) of documented demand. The forecasts are then matched to actual demand history to determine which one best fits the real-world data. The best-fit winner is used to create an objective base forecast.

Causal methods are used throughout the life cycle to adjust forecasts in anticipation of promotional events. Causal methods allow planners to predict how discounting and other promotional factors will affect volume, and layer the impact of these events on top of the underlying base forecast.

Finally, derived models can be used to create a Parent-Child relationship in which forecasts for closely related products are driven as a percentage of the forecast for a ‘leader’ product. This ensures that when the forecast is modified for the ‘parent’ all the ‘child’ forecasts would be updated accordingly.

To prevail in a business economy shaped by uncertain demand and rapid market changes, all of these forecasting methods must be harnessed. Advanced demand management tools can automate much of the selection and switching of methods as a product moves through its life cycle. A best-in-class forecasting system is one that provides flexibility for users to weight elements and override key parameters in the forecast calculation based on their intuitive knowledge and market expertise.


Article contributed by Logility. The original article can be found at www.logility.com