Moving average

src: i.ytimg.com

In statistics, a moving average (rolling average or running average) is a calculation to analyze data points by creating series of averages of different subsets of the full data set. It is also called a moving mean (MM) or rolling mean and is a type of finite impulse response filter. Variations include: simple, and cumulative, or weighted forms (described below).

Given a series of numbers and a fixed subset size, the first element of the moving average is obtained by taking the average of the initial fixed subset of the number series. Then the subset is modified by "shifting forward"; that is, excluding the first number of the series and including the next value in the subset.

A moving average is commonly used with time series data to smooth out short-term fluctuations and highlight longer-term trends or cycles. The threshold between short-term and long-term depends on the application, and the parameters of the moving average will be set accordingly. For example, it is often used in technical analysis of financial data, like stock prices, returns or trading volumes. It is also used in economics to examine gross domestic product, employment or other macroeconomic time series. Mathematically, a moving average is a type of convolution and so it can be viewed as an example of a low-pass filter used in signal processing. When used with non-time series data, a moving average filters higher frequency components without any specific connection to time, although typically some kind of ordering is implied. Viewed simplistically it can be regarded as smoothing the data.

Video Moving average

Simple moving average

In financial applications a simple moving average (SMA) is the unweighted mean of the previous n data. However, in science and engineering, the mean is normally taken from an equal number of data on either side of a central value. This ensures that variations in the mean are aligned with the variations in the data rather than being shifted in time. An example of a simple equally weighted running mean for a n-day sample of closing price is the mean of the previous n days' closing prices. If those prices are ${\displaystyle p_{M},p_{M-1},\dots ,p_{M-(n-1)}}$ then the formula is

${\displaystyle {\begin{aligned}{\overline {p}}_{\text{SM}}&={\frac {p_{M}+p_{M-1}+\cdots +p_{M-(n-1)}}{n}}\\&={\frac {1}{n}}\sum _{i=0}^{n-1}p_{M-i}\end{aligned}}}$

When calculating successive values, a new value comes into the sum and the oldest value drops out, meaning a full summation each time is unnecessary for this simple case,

${\displaystyle {\overline {p}}_{\text{SM}}={\overline {p}}_{{\text{SM}},{\text{prev}}}+{p_{M} \over n}-{p_{M-n} \over n}}$

The period selected depends on the type of movement of interest, such as short, intermediate, or long-term. In financial terms moving-average levels can be interpreted as support in a falling market, or resistance in a rising market.

If the data used are not centered around the mean, a simple moving average lags behind the latest datum point by half the sample width. An SMA can also be disproportionately influenced by old datum points dropping out or new data coming in. One characteristic of the SMA is that if the data have a periodic fluctuation, then applying an SMA of that period will eliminate that variation (the average always containing one complete cycle). But a perfectly regular cycle is rarely encountered.

For a number of applications, it is advantageous to avoid the shifting induced by using only 'past' data. Hence a central moving average can be computed, using data equally spaced on either side of the point in the series where the mean is calculated. This requires using an odd number of datum points in the sample window.

A major drawback of the SMA is that it lets through a significant amount of the signal shorter than the window length. Worse, it actually inverts it. This can lead to unexpected artifacts, such as peaks in the smoothed result appearing where there were troughs in the data. It also leads to the result being less smooth than expected since some of the higher frequencies are not properly removed.

Maps Moving average

Cumulative moving average

In a cumulative moving average, the data arrive in an ordered datum stream, and the user would like to get the average of all of the data up until the current datum point. For example, an investor may want the average price of all of the stock transactions for a particular stock up until the current time. As each new transaction occurs, the average price at the time of the transaction can be calculated for all of the transactions up to that point using the cumulative average, typically an equally weighted average of the sequence of n values ${\displaystyle x_{1}.\ldots ,x_{n}}$ up to the current time:

${\displaystyle {\textit {CMA}}_{n}={{x_{1}+\cdots +x_{n}} \over n}\,.}$

The brute-force method to calculate this would be to store all of the data and calculate the sum and divide by the number of datum points every time a new datum point arrived. However, it is possible to simply update cumulative average as a new value, ${\displaystyle x_{n+1}}$ becomes available, using the formula

${\displaystyle {\textit {CMA}}_{n+1}={{x_{n+1}+n\cdot {\textit {CMA}}_{n}} \over {n+1}}.}$

Thus the current cumulative average for a new datum point is equal to the previous cumulative average, times n, plus the latest datum point, all divided by the number of points received so far, n+1. When all of the datum points arrive (n = N), then the cumulative average will equal the final average. It is also possible to store a running total of the datum point as well as the number of points and dividing the total by the number of datum points to get the CMA each time a new datum point arrives.

The derivation of the cumulative average formula is straightforward. Using

${\displaystyle x_{1}+\cdots +x_{n}=n\cdot {\textit {CMA}}_{n}}$

and similarly for n + 1, it is seen that

${\displaystyle {\begin{aligned}x_{n+1}&=(x_{1}+\cdots +x_{n+1})-(x_{1}+\cdots +x_{n})\\[6pt]\end{aligned}}}$

Solving this equation for ${\displaystyle {\textit {CMA}}_{n+1}}$ results in

${\displaystyle {\begin{aligned}{\textit {CMA}}_{n+1}&={x_{n+1}+n\cdot {\textit {CMA}}_{n} \over {n+1}}\\[6pt]&={x_{n+1}+(n+1-1)\cdot {\textit {CMA}}_{n} \over {n+1}}\\[6pt]&={(n+1)\cdot {\textit {CMA}}_{n}+x_{n+1}-{\textit {CMA}}_{n} \over {n+1}}\\[6pt]&={{\textit {CMA}}_{n}}+{{x_{n+1}-{\textit {CMA}}_{n}} \over {n+1}}\end{aligned}}}$

src: i.investopedia.com

Weighted moving average

A weighted average is an average that has multiplying factors to give different weights to data at different positions in the sample window. Mathematically, the moving average is the convolution of the datum points with a fixed weighting function. One application is removing pixelisation from a digital graphical image.

In technical analysis of financial data, a weighted moving average (WMA) has the specific meaning of weights that decrease in arithmetical progression. In an n-day WMA the latest day has weight n, the second latest n - 1, etc., down to one.

${\displaystyle {\text{WMA}}_{M}={np_{M}+(n-1)p_{M-1}+\cdots +2p_{(M-n+2)}+p_{(M-n+1)} \over n+(n-1)+\cdots +2+1}}$

The denominator is a triangle number equal to ${\displaystyle {\frac {n(n+1)}{2}}.}$ In the more general case the denominator will always be the sum of the individual weights.

When calculating the WMA across successive values, the difference between the numerators of WMA_M+1 and WMA_M is np_M+1 - p_M - ??? - p_M-n+1. If we denote the sum p_M + ??? + p_M-n+1 by Total_M, then

${\displaystyle {\begin{aligned}{\text{Total}}_{M+1}&={\text{Total}}_{M}+p_{M+1}-p_{M-n+1}\\[3pt]{\text{Numerator}}_{M+1}&={\text{Numerator}}_{M}+np_{M+1}-{\text{Total}}_{M}\\[3pt]{\text{WMA}}_{M+1}&={{\text{Numerator}}_{M+1} \over n+(n-1)+\cdots +2+1}\end{aligned}}}$

The graph at the right shows how the weights decrease, from highest weight for the most recent datum points, down to zero. It can be compared to the weights in the exponential moving average which follows.

src: i.ytimg.com

Exponential moving average

An exponential moving average (EMA), also known as an exponentially weighted moving average (EWMA), is a first-order infinite impulse response filter that applies weighting factors which decrease exponentially. The weighting for each older datum decreases exponentially, never reaching zero. The graph at right shows an example of the weight decrease.

The EMA for a series Y may be calculated recursively:

${\displaystyle S_{t}={\begin{cases}Y_{1},&t=1\\\alpha \cdot Y_{t}+(1-\alpha )\cdot S_{t-1},&t>1\end{cases}}}$

Where:

• The coefficient ? represents the degree of weighting decrease, a constant smoothing factor between 0 and 1. A higher ? discounts older observations faster.
• Y_t is the value at a time period t.
• S_t is the value of the EMA at any time period t.

S₁ may be initialized in a number of different ways, most commonly by setting S₁ to Y₁ as shown above, though other techniques exist, such as setting S₁ to an average of the first 4 or 5 observations. The importance of the S₁ initialisations effect on the resultant moving average depends on ?; smaller ? values make the choice of S₁ relatively more important than larger ? values, since a higher ? discounts older observations faster.

Whatever is done for S₁ it assumes something about values prior to the available data and is necessarily in error. In view of this, the early results should be regarded as unreliable until the iterations have had time to converge. This is sometimes called a 'spin-up' interval. One way to assess when it can be regarded as reliable is to consider the required accuracy of the result. For example, if 3% accuracy is required, initialising with Y₁ and taking data after five time constants (defined above) will ensure that the calculation has converged to within 3% (only <3% of Y₁ will remain in the result ). Sometimes with very small alpha, this can mean little of the result is useful. This is analogous to the problem of using a convolution filter (such as a weighted average) with a very long window.

This formulation is according to Hunter (1986). By repeated application of this formula for different times, we can eventually write S_t as a weighted sum of the datum points Y_t, as:

${\displaystyle {\begin{aligned}S_{t}=\alpha &\left[Y_{t-1}+(1-\alpha )Y_{t-2}+(1-\alpha )^{2}Y_{t-3}+\cdots \right.\\[6pt]&\left.\cdots +(1-\alpha )^{k}Y_{t-(k+1)}\right]+(1-\alpha )^{k+1}S_{t-(k+1)}\end{aligned}}}$

for any suitable k ? {0, 1, 2, ...} The weight of the general datum point ${\displaystyle Y_{t-i}}$ is ${\displaystyle \alpha \left(1-\alpha \right)^{i-1}}$.

An alternate approach by Roberts (1959) uses Y_t in lieu of Y_t-1:

${\displaystyle S_{t,{\text{ alternate}}}=\alpha \cdot Y_{t}+(1-\alpha )\cdot S_{t-1}}$

This formula can also be expressed in technical analysis terms as follows, showing how the EMA steps towards the latest datum point, but only by a proportion of the difference (each time):

${\displaystyle {\text{EMA}}_{\text{today}}={\text{EMA}}_{\text{yesterday}}+\alpha \left[{\text{price}}_{\text{today}}-{\text{EMA}}_{\text{yesterday}}\right]}$

Expanding out ${\displaystyle {\text{EMA}}_{\text{yesterday}}}$ each time results in the following power series, showing how the weighting factor on each datum point p₁, p₂, etc., decreases exponentially:

${\displaystyle {\text{EMA}}_{\text{today}}={\alpha \left[p_{1}+(1-\alpha )p_{2}+(1-\alpha )^{2}p_{3}+(1-\alpha )^{3}p_{4}+\cdots \right]}}$

where

• ${\displaystyle p_{1}}$ is ${\displaystyle {\text{price}}_{\text{today}}}$
• ${\displaystyle p_{2}}$ is ${\displaystyle {\text{price}}_{\text{yesterday}}}$
• and so on

${\displaystyle {\text{EMA}}_{\text{today}}={\frac {p_{1}+(1-\alpha )p_{2}+(1-\alpha )^{2}p_{3}+(1-\alpha )^{3}p_{4}+\cdots }{1+(1-\alpha )+(1-\alpha )^{2}+(1-\alpha )^{3}+\cdots }},}$

since ${\displaystyle 1/\alpha =1+(1-\alpha )+(1-\alpha )^{2}+\cdots }$.

It can also be calculated recursively without introducing the error when initializing the first estimate (n starts from 1):

${\displaystyle {\text{EMA}}_{n}={\frac {{\text{WeightedSum}}_{n}}{{\text{WeightedCount}}_{n}}}}$

${\displaystyle {\text{WeightedSum}}_{n}=p_{n}+(1-\alpha ){\text{WeightedSum}}_{n-1}}$

${\displaystyle {\text{WeightedCount}}_{n}=1+(1-\alpha ){\text{WeightedCount}}_{n-1}={\frac {1-(1-\alpha )^{n}}{1-(1-\alpha )}}}$

Assume ${\displaystyle {\text{WeightedSum}}_{0}={\text{WeightedCount}}_{0}=0}$

This is an infinite sum with decreasing terms.

Approximating the EMA with a limited number of terms

The question of how far back to go for an initial value depends, in the worst case, on the data. Large price values in old data will affect the total even if their weighting is very small. If prices have small variations then just the weighting can be considered. The power formula above gives a starting value for a particular day, after which the successive days formula shown first can be applied. The weight omitted by stopping after k terms is

${\displaystyle \alpha \left[(1-\alpha )^{k}+(1-\alpha )^{k+1}+(1-\alpha )^{k+2}+\cdots \right],}$

which is

${\displaystyle \alpha (1-\alpha )^{k}\left[1+(1-\alpha )+(1-\alpha )^{2}+\cdots \right],}$

i.e. a fraction

${\displaystyle {\begin{aligned}&{\frac {{\text{weight omitted by stopping after }}k{\text{ terms}}}{\text{total weight}}}\\[6pt]={}&{\frac {\alpha \left[(1-\alpha )^{k}+(1-\alpha )^{k+1}+(1-\alpha )^{k+2}+\cdots \right]}{\alpha \left[1+(1-\alpha )+(1-\alpha )^{2}+\cdots \right]}}\\[6pt]={}&{\frac {\alpha (1-\alpha )^{k}{\frac {1}{1-(1-\alpha )}}}{\frac {\alpha }{1-(1-\alpha )}}}\\[6pt]={}&(1-\alpha )^{k}\end{aligned}}}$

out of the total weight.

For example, to have 99.9% of the weight, set above ratio equal to 0.1% and solve for k:

${\displaystyle k={\log(0.001) \over \log(1-\alpha )}}$

to determine how many terms should be used. Since ${\displaystyle \alpha \to 0}$ as ${\displaystyle N\to \infty }$, we know ${\displaystyle \log \,(1-\alpha )}$ approaches ${\displaystyle -\alpha }$ as N increases . This gives:

${\displaystyle k\approx {\log(0.001) \over {-\alpha }}}$

When ${\displaystyle \alpha }$ is related to N via to ${\displaystyle \alpha ={2 \over N+1}}$, this simplifies to approximately,

${\displaystyle k\approx 3.45(N+1)\,}$

for this example (99.9% weight).

Relationship between SMA and EMA

Note that there is no "accepted" value that should be chosen for ${\displaystyle \alpha }$ although there are some recommended values based on the application. A commonly used value for ${\displaystyle \alpha }$ is ${\displaystyle \alpha =2/(N+1)}$. This is because the weights of an SMA and EMA have the same "center of mass" when ${\displaystyle \alpha _{\mathrm {RMA} }=2/\left(N_{\mathrm {SMA} }+1\right)}$.

This is also why sometimes an EMA is referred to as an N-day EMA. Despite the name suggesting there are N periods, the terminology only specifies the ? factor. N is not a stopping point for the calculation in the way it is in an SMA or WMA. For sufficiently large N, the first N datum points in an EMA represent about 86% of the total weight in the calculation when ${\displaystyle \alpha =2/(N+1)}$:

Again, the designation of ${\displaystyle \alpha =2/\left(N+1\right)}$ it not a requirement. It is common terminology which helps people form an intuitive relationship between EMAs and SMAs when used together on the same datasets. But you can create an EMA with any value of ${\displaystyle \alpha }$ and you can either name it by simply stating the value of ${\displaystyle \alpha }$, or stick with the more familiar N-day EMA terminology and let ${\displaystyle N=\left(2/\alpha \right)-1}$.

Exponentially weighted moving variance and standard deviation

In addition to the mean, we may also be interested in the variance and in the standard deviation to evaluate the statistical significance of a deviation from the mean.

EWMVar can be computed easily along with the moving average. The starting values are ${\displaystyle {\text{EMA}}_{1}=x_{1}}$ and ${\displaystyle {\text{EMVar}}_{1}=0}$, and we then compute the subsequent values using:

${\displaystyle {\begin{aligned}\delta &=x_{i}-{\text{EMA}}_{i-1}\\{\text{EMA}}_{i}&={\text{EMA}}_{i-1}+\alpha \cdot \delta \\{\text{EMVar}}_{i}&=\left(1-\alpha \right)\cdot \left({\text{EMVar}}_{i-1}+\alpha \cdot \delta ^{2}\right)\end{aligned}}}$

From this, the exponentially weighted moving standard deviation can be computed as ${\displaystyle {\text{EWSD}}_{i}={\sqrt {{\text{EMVar}}_{i}}}}$. We can then use the standard score to normalize data with respect to the moving average and variance. This algorithm is based on Welford's algorithm for computing the variance.

Modified moving average

A modified moving average (MMA), running moving average (RMA), or smoothed moving average (SMMA) is defined as:

${\displaystyle {\overline {p}}_{MM,{\text{today}}}={\frac {(N-1){\overline {p}}_{MM,{\text{yesterday}}}+p_{\text{today}}}{N}}}$

In short, this is an exponential moving average, with ${\displaystyle \alpha =1/N}$.

Application to measuring computer performance

Some computer performance metrics, e.g. the average process queue length, or the average CPU utilization, use a form of exponential moving average.

${\displaystyle S_{n}=\alpha (t_{n}-t_{n-1})Y_{n}+\left[1-\alpha (t_{n}-t_{n-1})\right]S_{n-1}.}$

Here ? is defined as a function of time between two readings. An example of a coefficient giving bigger weight to the current reading, and smaller weight to the older readings is

${\displaystyle \alpha (t_{n}-t_{n-1})=1-\exp \left({-{\frac {t_{n}-t_{n-1}}{W\cdot 60}}}\right)}$

where exp() is the exponential function, time for readings t_n is expressed in seconds, and W is the period of time in minutes over which the reading is said to be averaged (the mean lifetime of each reading in the average). Given the above definition of ?, the moving average can be expressed as

${\displaystyle S_{n}=\left[1-\exp \left(-{{t_{n}-t_{n-1}} \over {W\cdot 60}}\right)\right]Y_{n}+\exp \left(-{{t_{n}-t_{n-1}} \over {W\cdot 60}}\right)S_{n-1}}$

For example, a 15-minute average L of a process queue length Q, measured every 5 seconds (time difference is 5 seconds), is computed as

${\displaystyle {\begin{aligned}L_{n}&=\left[1-\exp \left({-{\frac {5}{15\cdot 60}}}\right)\right]Q_{n}+e^{-{\frac {5}{15\cdot 60}}}L_{n-1}\\[6pt]&=\left[1-\exp \left({-{\frac {1}{180}}}\right)\right]Q_{n}+e^{-{\frac {1}{180}}}L_{n-1}\\[6pt]&=Q_{n}+e^{-{\frac {1}{180}}}\left(L_{n-1}-Q_{n}\right)\end{aligned}}}$

src: i.investopedia.com

Other weightings

Other weighting systems are used occasionally - for example, in share trading a volume weighting will weight each time period in proportion to its trading volume.

A further weighting, used by actuaries, is Spencer's 15-Point Moving Average (a central moving average). The symmetric weight coefficients are -3, -6, -5, 3, 21, 46, 67, 74, 67, 46, 21, 3, -5, -6, -3.

Outside the world of finance, weighted running means have many forms and applications. Each weighting function or "kernel" has its own characteristics. In engineering and science the frequency and phase response of the filter is often of primary importance in understanding the desired and undesired distortions that a particular filter will apply to the data.

A mean does not just "smooth" the data. A mean is a form of low-pass filter. The effects of the particular filter used should be understood in order to make an appropriate choice. On this point, the French version of this article discusses the spectral effects of 3 kinds of means (cumulative, exponential, Gaussian).

src: www.nickgillian.com

Moving median

From a statistical point of view, the moving average, when used to estimate the underlying trend in a time series, is susceptible to rare events such as rapid shocks or other anomalies. A more robust estimate of the trend is the simple moving median over n time points:

${\displaystyle {\widetilde {p}}_{\text{SM}}={\text{Median}}(p_{M},p_{M-1},\ldots ,p_{M-n+1})}$

where the median is found by, for example, sorting the values inside the brackets and finding the value in the middle. For larger values of n, the median can be efficiently computed by updating an indexable skiplist.

Statistically, the moving average is optimal for recovering the underlying trend of the time series when the fluctuations about the trend are normally distributed. However, the normal distribution does not place high probability on very large deviations from the trend which explains why such deviations will have a disproportionately large effect on the trend estimate. It can be shown that if the fluctuations are instead assumed to be Laplace distributed, then the moving median is statistically optimal. For a given variance, the Laplace distribution places higher probability on rare events than does the normal, which explains why the moving median tolerates shocks better than the moving mean.

When the simple moving median above is central, the smoothing is identical to the median filter which has applications in, for example, image signal processing.

src: www.fxtradermagazine.com

Moving average regression model

In a moving average regression model, a variable of interest is assumed to be a weighted moving average of unobserved independent error terms; the weights in the moving average are parameters to be estimated.

Those two concepts are often confused due to their name, but while they share many similarities, they represent distinct methods and are used in very different contexts.

src: www.nickgillian.com

See also

• Exponential smoothing
• Moving average convergence/divergence indicator
• Window function
• Moving average crossover
• Rising moving average
• Running total
• Local regression
• Kernel smoothing
• Moving least squares
• Zero lag exponential moving average

src: i.ytimg.com

Notes and references

src: www.tradingsetupsreview.com

External links

Source of article : Wikipedia