Gmail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Process identification from autocorrelation plot
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  6 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Edward Jensen  
View profile  
 More options Nov 3, 10:03 am
Newsgroups: sci.stat.math
From: "Edward Jensen" <edw...@jensen.invalid>
Date: Tue, 3 Nov 2009 00:03:29 +0100
Local: Tues, Nov 3 2009 10:03 am
Subject: Process identification from autocorrelation plot
Hi.

I'm doing some modeling of time series data recorded from a accelerometer at
rest for several hours.
I have the following empirical autocorrelation plot:
http://imageshack.dk/imagesfree/msi02421.png

I get a pretty good fit by taking the first derivative of the series and
fitting a MA(2) model, a ARIMA(0,1,2) model.
My question is: Can you see directly from the autocorrelation plot that this
is an appropriate model?

Thanks in advance.


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
David Jones  
View profile  
 More options Nov 3, 9:04 pm
Newsgroups: sci.stat.math
From: "David Jones" <dajx...@ceh.ac.uk>
Date: Tue, 3 Nov 2009 10:04:20 -0000
Local: Tues, Nov 3 2009 9:04 pm
Subject: Re: Process identification from autocorrelation plot

Edward Jensen wrote:
> Hi.

> I'm doing some modeling of time series data recorded from a
> accelerometer at rest for several hours.
> I have the following empirical autocorrelation plot:
> http://imageshack.dk/imagesfree/msi02421.png

> I get a pretty good fit by taking the first derivative of the series
> and fitting a MA(2) model, a ARIMA(0,1,2) model.
> My question is: Can you see directly from the autocorrelation plot
> that this is an appropriate model?

> Thanks in advance.

No. Suggest you do both:
(i) ACF plot of first differences
(ii) ACF plot of residuals from a smooothed trend line.
Also, plot series against time, with smoothed trend lines and a fitted linear trend and use this to help judge and appropriate model.

David Jones


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
aruzinsky  
View profile  
 More options Nov 4, 3:01 am
Newsgroups: sci.stat.math
From: aruzinsky <aruzin...@general-cathexis.com>
Date: Tue, 3 Nov 2009 08:01:14 -0800 (PST)
Local: Wed, Nov 4 2009 3:01 am
Subject: Re: Process identification from autocorrelation plot
On Nov 2, 5:03 pm, "Edward Jensen" <edw...@jensen.invalid> wrote:

> Hi.

> I'm doing some modeling of time series data recorded from a accelerometer at
> rest for several hours.
> I have the following empirical autocorrelation plot:http://imageshack.dk/imagesfree/msi02421.png

> I get a pretty good fit by taking the first derivative of the series and
> fitting a MA(2) model, a ARIMA(0,1,2) model.
> My question is: Can you see directly from the autocorrelation plot that this
> is an appropriate model?

> Thanks in advance.

Just out of curiosity,

1. What is the sample mean (average) of the undifferenced data?

2. If the sample mean is not nearly zero, did you forget to subtract
it in calculating autocorrelation and/or model parameters?

3. After subtracting the sample mean, what do you get by LS fit of AR
(1) model, Xk = a1*Xk-1 + Ek, to undifferenced data?  If |a1| < 1, you
probably shouldn't take difference the data.


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Edward Jensen  
View profile  
 More options Nov 5, 3:05 am
Newsgroups: sci.stat.math
From: "Edward Jensen" <edw...@jensen.invalid>
Date: Wed, 4 Nov 2009 17:05:19 +0100
Local: Thurs, Nov 5 2009 3:05 am
Subject: Re: Process identification from autocorrelation plot
"aruzinsky" <aruzin...@general-cathexis.com> wrote in message

news:8955efee-15d9-4e50-a516-1ecfa83cd71f@a21g2000yqc.googlegroups.com...
On Nov 2, 5:03 pm, "Edward Jensen" <edw...@jensen.invalid> wrote:

>> Hi.

>> I'm doing some modeling of time series data recorded from a accelerometer
>> at
>> rest for several hours.
>> I have the following empirical autocorrelation
>> plot:http://imageshack.dk/imagesfree/msi02421.png

>> I get a pretty good fit by taking the first derivative of the series and
>> fitting a MA(2) model, a ARIMA(0,1,2) model.
>> My question is: Can you see directly from the autocorrelation plot that
>> this
>> is an appropriate model?
>Just out of curiosity,
>1. What is the sample mean (average) of the undifferenced data?

mean(accelX)
[1] -190.7404

>2. If the sample mean is not nearly zero, did you forget to subtract
>it in calculating autocorrelation and/or model parameters?

No.

>3. After subtracting the sample mean, what do you get by LS fit of AR
>(1) model, Xk = a1*Xk-1 + Ek, to undifferenced data?  If |a1| < 1, you
>probably shouldn't take difference the data.

I get a1 = 0.0752
Here a plot of the autocorrelation of the residuals from the AR(1) model:
http://imageshack.dk/imagesfree/0ZN50110.png
Would you say this is good fit?

Based on the autocorrelation plot of the original time series, what made you
think that AR(1) was a good model?

I have read the chapter from Box and Jenkins about model identification.
Their approach is to first study the autocorrelation of the zeroth, first
and second order differenced time series. Based on where the correlations
and partial correlations become zero (or close to) they select an ARMA
model. In my time series the ACF of first order differenced data only show a
significant correlation at lag 1. That's why I tried to model the
differenced data.

Best regards,
Andreas


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Edward Jensen  
View profile  
 More options Nov 5, 3:12 am
Newsgroups: sci.stat.math
From: "Edward Jensen" <edw...@jensen.invalid>
Date: Wed, 4 Nov 2009 17:12:42 +0100
Local: Thurs, Nov 5 2009 3:12 am
Subject: Re: Process identification from autocorrelation plot
"Edward Jensen" <edw...@jensen.invalid> wrote in message

news:hcs8o0$seq$1@news.net.uni-c.dk...

I should also be noted that I have tried fitted AR models of increasing
order but based on AIC, the best model is about p = 190. By including a MA
term, I can get decent fits with just a couple of terms.

    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
aruzinsky  
View profile  
 More options Nov 12, 3:46 am
Newsgroups: sci.stat.math
From: aruzinsky <aruzin...@general-cathexis.com>
Date: Wed, 11 Nov 2009 08:46:25 -0800 (PST)
Local: Thurs, Nov 12 2009 3:46 am
Subject: Re: Process identification from autocorrelation plot
On Nov 4, 10:05 am, "Edward Jensen" <edw...@jensen.invalid> wrote:

I can't be more specific because I haven't been active in time series
analysis for 20 years, but this is what I think I remember:

A little known important fact that is missing from many textbooks is
that Least Squares (LS) is a consistent estimator of both stable and
UNSTABLE AR processes, i.e., with poles inside, on, or outside the
unit circle.  For example, if your data is a random walk,

Xk = Xk-1 + Ek,

then Least Squares will give an estimate a1 ~= 1.  With your LS
estimate, a1 = 0.0752, your time series is not close to a random walk
therefore you should not difference the data after subtracting the
mean.  This does not imply that an AR(1) model is best, it implies
that, after subtracting the mean, you should use an ARMA rather than
an ARIMA model.


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google