Home

Datascience

Correlation Testing Geo-Timeseries Linear Regressions Machine Learning Data Science Python Eda Spatial Data Stationarity Data Visualization

Don't Look! I'm changing!

URL Copied

https://towardsdatascience.com/stationarity-in-time-series-analysis-90c94f27322 Stationarity in time series analysis (stochastic processes)


 In the most intuitive sense, stationarity means that the statistical properties of a process generating a time series do not change over time.			
 t does not mean that the series does not change over time, just that the way it changes does not itself change over time.			
 he value of a linear function changes as 𝒙 grows, but the way it changes remains constant			
 β€” it has a constant slope; one value that captures that rate of change.			
             
 Why is this important?			
     stationary processes are a sub-class of a wider family of possible models of reality		
     his sub-class is much easier to model and investigate.		
     common assumption for		
         trend estimation	
         forecasting	
         causal inference	
         other	
 A formal definition for stochastic processes			
 Stochastic Processes			consider the observed time series as part of a realization of a stochastic proces
 Definitions of stationarity			
     statistical properties of the process do not change over time		
     several different notions of stationarity have been suggested in econometric literature over the years		
     stationarity β€” of any kind β€” is a property of a stochastic process		
     Strong stationarity		
         This is the most common definition of stationarity, and it is commonly referred to simply as stationarity	
         t is sometimes also referred to as strict-sense stationarity or strong-sense stationarity.	
         a variables distribution in a sub-sequence within the stochastic process will be shift invarient. 	
         i.e. a variables distribution requires shift invariance	
     Weak stationarity		
         This means the process has the same mean at all time points, and that the covariance between the values at any two time points depend only on the difference between the two times, and not on the location of the points along the time axis.	
         Can have, stationary mean or stationary variance. if it has both it is strong, if it has neither it is neither	
     N-th order stationarity		
         demands the shift-invariance (in time) of the distribution of any n samples of the stochastic process	
     First-order stationarity		
         The term first-order stationarity is sometimes used to describe a series that has means that never changes with time	
         but for which any other moment (like variance) can change.[Boshnakov, 2011]	
     Cyclostationarity		
         if the joint distribution of any set of samples is invariant over a time shift of mP	
     Trend stationarity		
         if an underlying trend (function solely of time) can be removed, leaving a stationary process	
     Joint stationarity		
         Intuitive extensions exist of all of the above types of stationarity for pairs of stochastic processes.	
     Locally stationary stochastic processes		
         An important class of non-stationary processes are locally stationary (LS) processes	
         their statistical properties change slowly over time.	
         gradually changing in an unspecific way as time evolves	
         LS processes are of importance because they somewhat bridge the gap between	
             the thoroughly explored sub-class of parametric non-stationary processes (see the following section)
             and the uncharted waters of the wider family of non-parametric processes
     Parametric notions of non-stationarity		
         The definitions of stationarity presented so far have been non-parametric;	
         and thus apply to any stochastic process	
         WIKI: Parametric tests assume underlying statistical distributions in the data.	
         WIKI: Stochastic: randomly determined; having a random probability distribution or pattern that may be analyzed statistically but may not be predicted precisely.	
             
             

https://towardsdatascience.com/detecting-stationarity-in-time-series-data-d29e0a21e638 Detecting stationarity in time series data Looking at Autocorrelation Function (ACF) plots Autocorrelation is the correlation of a signal with a delayed copy β€” or a lag β€” of itself as a function of the delay. When plotting the value of the ACF for increasing lags (a plot called a correlogram), the values tend to degrade to zero quickly for stationary time series (see figure 1, right), while for non-stationary data the degradation will happen more slowly (see figure 1, left). Alternatively, [Nielsen, 2006] suggests that plotting correlograms based on both autocorrelations and scaled autocovariances, and comparing them, Parametric tests more rigorous approac using statistical tests developed to detect specific types of stationarity, Unit root tests

         The Dickey-Fuller Test	
         The Dickey-Fuller test was the first statistical test developed to test the null hypothesis that a unit root is present in an autoregressive model of a given time series	
         The KPSS Test	
         Another prominent test for the presence of a unit root is the KPSS test. [Kwiatkowski et al, 1992] Conversely to the Dickey-Fuller family of tests, the null hypothesis assumes stationarity around a mean or a linear trend, while the alternative is the presence of a unit root.	
         The Zivot and Andrews Test	
         The aforementioned tests do not allow for the possibility of a structural break	
         β€” an abrupt change involving a change in the mean or other parameters of the process.	
         the power to reject a unit root decreases when the stationary alternative is true and a structural break is ignored.	
         [Zivot and Andrews, 1992] propose a unit root test in which they assume that the exact time of the break-point is unknown	
         Semi-parametric unit root tests	
         Variance Ratio Test	
         [Breitung, 2002] suggested a non-parametric test for the presence of a unit root based on a variance ratio statistic.	
     Non-parametric tests		
         limitations of parametric tests	
         recognition they cover only a narrow sub-class of possible cases encountered in real data	
         no longer have to assume very simple parametric models happen to apply to your data to find out whether it is stationary or not	
         A Nonparametric Test for Stationarity in Continuous-Time Markov Processes	
         A nonparametric test for stationarity in functional time series	
         A nonparametric test for stationarity based on local Fourier analysis	
             

https://towardsdatascience.com/inferring-causality-in-time-series-data-b8b75fe52c46 Background: Notions of causality in time series data Granger causality⁸