Back to PLS Help

Using subject scores for cross validation
grace
Posted on 05/06/13 19:05:27
Number of posts: 16
grace posts:

My question is twofold:

1) Can we use subject scores (e.g. those in panel 3 of figure 1, and the bottom of figures 2 and 3 of McIntosh et al. 1996 NeuroImage) for cross-validation? i.e. can we leave one subject out, perform PLS for the remaining subjects, then multiply the resulting singular images (B1 in 1996 paper) with the excluded subject's brain images to arrive at subject scores per condition for the excluded subject, then perform some sort of sum-square differences calculation to predict which condition the subject was undergoing?

2) If the answer to (1) is yes, can we use the contents of the results .mat files and individual subject datamats to do this? Which variables correspond to the brain images and singular images?

Thank you!

Grace

Replies:

Untitled Post

I'm Online
jshen
Posted on 05/06/13 22:18:34
Number of posts: 291
jshen replies:

In your second question, variables result.u and result.v in result.mat files are both singular images. Especially, result.u is singular image related to the brain, and we sometimes call it BrainLV or Salience. result.s is singular value. In result.mat, you cannot find brain image, unless you checked "save data" when you run PLS analysis from GUI window, which is unchecked by default. That's all I know.

 



Untitled Post
grace
Posted on 05/06/13 22:25:08
Number of posts: 16
grace replies:

Thank you! Do you know how I could save these if I am using batch_plsgui? 

Also, how do you find the brain image for each individual subject? I was hoping this would be a variable in the datamat file.

 

Thanks again,

Grace



Untitled Post

I'm Online
jshen
Posted on 05/06/13 22:32:06
Number of posts: 291
jshen replies:

quote:

Thank you! Do you know how I could save these if I am using batch_plsgui? 

Also, how do you find the brain image for each individual subject? I was hoping this would be a variable in the datamat file.

 

Thanks again,

Grace

When you use batch_plsgui, set "save_data" parameter to 1 in the analysis script.

Brain image for individual subject is in sessiondata.mat file, with variable "datamat".

 



Untitled Post
rmcintosh
Posted on 05/07/13 05:26:08
Number of posts: 394
rmcintosh replies:

Hi Grace - the answer to (1) is yes, but that essentially what the bootstrapping approach does.  Instead of one subject, it resamples with replacement, so it may leave more than one person out in an given resample.  It recalculates the SVD each time based on the new sample and thus we derive confidence intervals for the U and V side of the decomposition.  The method you propose would work, but you need to go back to the datamat each time to recalculate the SVD.

Does the bootstrap approach we use suffice for your needs or do you need something more?



Untitled Post
grace
Posted on 05/07/13 11:37:06
Number of posts: 16
grace replies:

I'd like to be able to predict the condition based on brain activity for a novel subject, which I think is slightly different from the statistical significance that bootstrapping is used to show.. is that right?

The biggest problem I'm facing with the programming part of things is that the singular images from PLS contain different voxels from the left out subject. How was this dealt with in the bootstrapping approach?

 

Thanks,

Grace



Untitled Post
rmcintosh
Posted on 05/08/13 07:49:29
Number of posts: 394
rmcintosh replies:

 

I'd like to be able to predict the condition based on brain activity for a novel subject, which I think is slightly different from the statistical significance that bootstrapping is used to show.. is that right?

For a new subject, you wouldn't necessarily use bootstrap.  Given you can get standard error estimates from the bootstrap, however, you can compute the new person's score and see where their scores sits in the distribution.

The biggest problem I'm facing with the programming part of things is that the singular images from PLS contain different voxels from the left out subject. How was this dealt with in the bootstrapping approach?

In the results files there is a 'st_coords' vector [the exact name will differ depending on the module for analysis] that has the matrix locations for the voxels all subjects had in common for the analysis.  You can use this to extract the same voxels for the new subject.
 
 


Untitled Post
grace
Posted on 05/08/13 11:14:24
Number of posts: 16
grace replies:

 

In the results files there is a 'st_coords' vector [the exact name will differ depending on the module for analysis] that has the matrix locations for the voxels all subjects had in common for the analysis.  You can use this to extract the same voxels for the new subject.
 
 
So I would take the intersection of the new subject's st_coords and the one from the PLS results file? I was concerned because this sacrifices voxels from both the new subject and the PLS vector.
 
Thanks!


Untitled Post
grace
Posted on 05/10/13 17:45:05
Number of posts: 16
grace replies:

Sorry for all the questions, one more thing.. in the results.mat, how is st_datamat structured? Is it arranged by condition then by subject, such that if I had 3 conditions and 20 subjects, the first 20 rows would be the datamats for condition 1, subjects 1 through 20?

Thanks,

Grace



Untitled Post

I'm Online
jshen
Posted on 05/10/13 18:06:20
Number of posts: 291
jshen replies:

quote:

Sorry for all the questions, one more thing.. in the results.mat, how is st_datamat structured? Is it arranged by condition then by subject, such that if I had 3 conditions and 20 subjects, the first 20 rows would be the datamats for condition 1, subjects 1 through 20?

Thanks,

Grace

Yes, it is.


Untitled Post

I'm Online
jshen
Posted on 05/10/13 18:07:12
Number of posts: 291
jshen replies:

quote:

Sorry for all the questions, one more thing.. in the results.mat, how is st_datamat structured? Is it arranged by condition then by subject, such that if I had 3 conditions and 20 subjects, the first 20 rows would be the datamats for condition 1, subjects 1 through 20?

Thanks,

Grace

Yes, it is.



Login to reply to this topic.

  • Keep in touch

Enter your email above to receive electronic messages from Baycrest, including invitations to programs and events, newsletters, updates and other communications.
You can unsubscribe at any time.
Please refer to our Privacy Policy or contact us for more details.

  • Follow us on social
  • Facebook
  • Instagram
  • Linkedin
  • Pinterest
  • Twitter
  • YouTube

Contact Us:

3560 Bathurst Street
Toronto, Ontario
Canada M6A 2E1
Phone: (416) 785-2500

Baycrest is an academic health sciences centre fully affiliated with the University of Toronto