TCN: Difference between revisions

From RedwoodCenter
Jump to navigationJump to search
(75 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Topics in Computational Neuroscience ==
== Topics in Computational Neuroscience ==


=== Time and Location ===
=== Summer 2010 ===
<font color="#ff0000">New meeting time:</font> '''1pm''' every Thursday in the Redwood Center (508-20 Evans).
* [September 23] Bullier, Jean.  "What is Fed Back?" in 23 Problems in Systems Neuroscience. [https://docs.google.com/fileview?id=0B30YK-ZtKoHXNGVlYjNlODUtNTYyOS00OTJmLWJjNWItNmUwNTljYmE3M2U4&hl=en&authkey=CMvu2LAM]
* [June 10] 
** Jarzynski, Nonequilibrium work relations: foundations and applications. [http://tinyurl.com/2fxyowa]
** Crooks, Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian Systems. [http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.63.4984&rep=rep1&type=pdf]
** Crooks, Beyond Boltzmann-Gibbs statistics: Maximum entropy hyperensembles out of equilibrium [http://www.google.com/url?sa=t&source=web&cd=1&ved=0CBIQFjAA&url=http%3A%2F%2Fthreeplusone.com%2Fpubs%2Ffulltext%2FCrooks2007b.pdf&ei=G4QZTJKNKoLSNYCj8PcI&usg=AFQjCNEPftRKxOfq3hMWSCxpOQeTyZErZA&sig2=2xhgXNLHQQuWcN82MJBU_g]


=== Overview ===
* [May 20] Truccolo et al., Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes [http://www.nature.com/neuro/journal/v13/n1/abs/nn.2455.html/]
If you would like, please register for VS 298 Section 3, Course Control Number (CCN) 66487, for 1 unit, S/U. The class will later be cross listed under Neuroscience.


This class is aimed at graduate students from the neuroscience program, neuroscience related life sciences, as well as students from engineering, physics, and math programs with an interest in a computational approach to studying the brain. The class will provide a broad survey of literature from theoretical and computational neuroscience. Readings for the class will be selected from the best papers in the field and will combine both seminal works and recent theories. The class is scheduled to meet for one session each week for 1.5 hours for each session.
=== Spring 2010 ===


=== E-mail List ===
* [May 13] A review of active learning (no paper).


redwood_tcn at lists.berkeley.edu
* [Apr 29] Ranzato and Hinton, Modeling Pixel Means and Covariances Using Factorized Third-Order Boltzmann Machines [http://www.cs.toronto.edu/~ranzato/publications/ranzato_cvpr2010.pdf]


You can subscribe yourself via the web [http://list.berkeley.edu link] (recommended way) or by sending mail to: majordomo@lists.berkeley.edu that contains:
* [Apr 22] Boureau et al., Learning Mid-Level Features For Recognition [http://yann.lecun.com/exdb/publis/pdf/boureau-cvpr-10.pdf]


        subscribe redwood_tcn
* [Apr 15] Neghaban et al., A unified framework for the analysis of regularized $M$-estimators.[http://www.eecs.berkeley.edu/~sahand_n/highdimrates.pdf]


in the body of the message.
* [Apr 6] Lucke et al., Occlusive components analysis. [http://www.fias.uni-frankfurt.de/~luecke/Publications/LuckeEtAl2009.pdf]


=== Guidelines for Presenting Papers ===
* [Mar 25] Bießmann et al., Decision-related activity in sensory neurons reflects more than a neuron's causal effect.[http://www.springerlink.com/content/e1425487365v2227]
Each person that selects a paper should present, in about 15 minutes (no slides):
* an executive summary
* an outline of the key points, ideas, or contributions
* a description of the key figures
* what you took away from the paper
* some potential questions for discussion


=== Make a Topic or Paper Suggestion ===
* [Mar 18] Itskov and Abbott, Pattern Capacity of a Perceptron for Sparse Discrimination. [http://neurotheory.columbia.edu/~larry/ItskovPRL08.pdf]


[[Suggestion Board]] (To gain access send email to: cadieu at berkeley dot edu)
* [Mar 11] Nienborg and Cumming, Decision-related activity in sensory neurons reflects more than a neuron's causal effect.[http://www.nature.com/nature/journal/v459/n7243/full/nature07821.html]


=== Upcoming presenters ===
* [Feb 18] Masse et al., Olfactory Information Processing in Drosophila. [http://download.cell.com/current-biology/pdf/PIIS0960982209013013.pdf]


* November 20th -- - Presenter: <font color="#ff0000">Rama Natarajan</font>
* [Feb 11] Yaghoobi et al., Dictionary Learning for Sparse Approximations with the Majorization Method. [http://www.see.ed.ac.uk/%7Es0574225/YBD_DLMM_TSP.pdf]
* November 27th -- - Presenter: <font color="#ff0000"></font>


[[Suggestion Board]] (To gain access send email to: jascha at berkeley dot edu)
* [Feb 4] Ecker et al., Decorrelated Neuronal Firing in Cortical Microcircuits. [http://www.sciencemag.org/cgi/content/abstract/327/5965/584]
* [Feb 4] Renart et al., The Asynchronous State in Cortical Circuits. [http://www.sciencemag.org/cgi/content/abstract/327/5965/587]


=== Syllabus (Topics and Readings) ===
* [Jan 28] Recht et al., Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization. [http://pages.cs.wisc.edu/~brecht/papers/07.rfp.lowrank.pdf]


<big>&#10004;</big> indicates papers we've read.
=== Fall 2009 ===


==== Last papers covered ====
* [Dec 3] Kolgin et al., Frequency of gamma oscillations routes flow of information in the hippocampus. [http://www.nature.com/nature/journal/v462/n7271/abs/nature08573.html]


* <big>&#10004;</big> Tutorial on Conjugate Gradient - no paper but ''An Introduction to the Conjugate Gradient Method Without the Agonizing Pain'' by Jonathan Richard Shewchuk might be useful: [http://www.cs.cmu.edu/~quake-papers/painless-conjugate-gradient.pdf link] - Presenter: <font color="#ff0000">Chris Hillar</font>
* [Nov 17] Graham, Chandler, Field. Can the theory of ‘‘whitening’’ explain the center-surround properties of retinal ganglion cell receptive fields? [http://math.dartmouth.edu/~dgraham/dg/rgc-paper.pdf]


* <big>&#10004;</big> Tutorial on Natural Gradient - no paper but ''Amari. Natural gradient works efficiently in learning. Neural Computation'', Amari 1998 might be useful: [http://www.mitpressjournals.org/doi/abs/10.1162/089976698300017746 link] - Presenter: <font color="#ff0000">Jascha</font>
* [Nov 12] Lighthill and AI community debate, 1973. [http://www.aiai.ed.ac.uk/events/lighthill1973/]


* <big>&#10004;</big> ''Distilling Free-Form Natural Laws from Experimental Data'', Michael Schmidt1 and Hod Lipson 2009. Science 324(59233): [http://sciencemag.org/cgi/content/abstract/324/5923/81 link] - Presenter: <font color="#ff0000">Daniel</font>
* [Oct 29, Nov 5] George, Hawkins, Towards a Mathematical Theory of Cortical Micro-circuits. [http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1000532]


* <big>&#10004;</big> ''Learning Optical Flow'', Deqing Sun, Stefan Roth, J. P. Lewis, and Michael Black. EECV 2008: [http://www.gris.informatik.tu-darmstadt.de/~sroth/pubs/eccv2008.pdf link] - Presenter: <font color="#ff0000">Jack</font>
* [Oct 22]: Berkes et al., A Structured Model of Video Reproduces Primary Visual Cortical Organisation.[http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1000495]


* <big>&#10004;</big> ''Decision-theoretic saliency: computational principles, biological plausibility, and implications for neurophysiology and psychophysics'', Gao D, Vasconcelos N. Neural Comput. 2009 Jan;21(1):239-71.: [http://www.ncbi.nlm.nih.gov/pubmed/19210172?ordinalpos=1&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum link] - Presenter: <font color="#ff0000">Daniel</font>
* [Oct 15]: Petreanu et al., The subcellular organization of neocortical excitatory connections. [http://www.nature.com/nature/journal/v457/n7233/pdf/nature07709.pdf]


* <big>&#10004;</big> ''Temporal interactions between cortical rhythms'', Roopun AK, Kramer MA, Carracedo LM, Kaiser M, Davies CH, Traub RD, Kopell NJ and Whittington MA. (2008) Front. Neurosci. 2,2:145-154. doi:10.3389/neuro.01.034.2008: [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2622758 link] - Presenter: <font color="#ff0000">Kilian</font>
* [Oct 15]: Arenz et al. The contribution of single synapses to sensory representation in vivo. [http://www.sciencemag.org/cgi/content/full/321/5891/977]


* <big>&#10004;</big> ''Recognition of natural scenes from global properties: seeing the forest without representing the trees'', Greene, M.R. & Oliva, A. 2009 Cognitive Psychology Vol. 58(2), pp. 137-76 [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WCR-4TB9P8G-1&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=3033c96c7f8db6b8a6f6761be811ad79 link] - Presenter: <font color="#ff0000">Paul Ivanov</font>
* [Oct 1,8]: Kobilarov et al., Lie Group Integrators for Animation and Control of Vehicles.[http://www.geometry.caltech.edu/pubs/KCD09.pdf]


* <big>&#10004;</big> ''Cogito componentiter ergo sum'', Lars Kai Hansen and Ling Feng. Lecture Notes in Computer Science, 2006: [http://www.springerlink.com/index/j456687g40246n57.pdf link] - Presenter: <font color="#ff0000">?</font>
=== [[Past TCN Papers]] ===


* <big>&#10004;</big> Tutorial on representation theory and invariance - no paper but ''A novel set of rotationally and translationally invariant features for images based on the non-commutative bispectrum'' by Risi Kondor might be useful: [http://arxiv.org/abs/cs.CV/0701127 link] - Presenter: <font color="#ff0000">Chris Hillar</font>
===[[Suggestion Board]]===


* <big>&#10004;</big> ''If I Were You: Perceptual Illusion of Body Swapping'', Petkova VI, Ehrsson HH 2008. PLoS ONE 3(12): e3832 doi:10.1371/journal.pone.0003832 [http://www.plosone.org/article/info:doi%2F10.1371%2Fjournal.pone.0003832 link] - Presenter: <font color="#ff0000">Jascha</font>
=== Time and Location ===
'''1:10-2:00pm''' usually every Thursday in the Redwood Center (508-20 Evans).


* <big>&#10004;</big> ''Multisensory integration in macaque visual cortex depends on cue reliability'', Morgan ML, Deangelis GC, Angelaki DE., Neuron. 2008 Aug 28;59(4):662-73. [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6WSS-4T9MB77-H&_user=4420&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000059607&_version=1&_urlVersion=0&_userid=4420&md5=af04fa45c08906f07d4f7d270335cdc6 link] - Presenter: <font color="#ff0000">Rama Natarajan</font>
=== Overview ===
This journal club is aimed at graduate students from the neuroscience program, neuroscience related life sciences, as well as students from engineering, physics, and math programs with an interest in a computational approach to studying the brain. It provides a broad survey of literature from theoretical and computational neuroscience. Readings will combine both seminal works and recent theories. We meet for one session each week.


* <big>&#10004;</big> ''Design of Linear Equalizers Optimized for the Structural Similarity Index'', S. Channappayya, Alan Bovik, C. Caramanis, R. Heath Jr; IEEE Transactions on Image Processing, Vol 17 NO 6 June 2008 [http://ieeexplore.ieee.org/search/srchabstract.jsp?arnumber=4483677&isnumber=4515964&punumber=83&k2dockey=4483677@ieeejrns&query=%28%28bovik%29%3Cin%3Emetadata%29&pos=4&access=no link] - Presenter: <font color="#ff0000">Jimmy</font>
It is possible to take this seminar for credit. If you would like to do so, please mention during journal club.


* <big>&#10004;</big> ''Kalman filtered compressed sensing'', Namrata Vaswani, ICIP 2008 [http://arxiv.org/abs/0804.0819 link] - Presenter: <font color="#ff0000">Jack</font>
You can also contact the club organizer at [http://mailhide.recaptcha.net/d?k=016pBbHfjDIqQ3wlYCciKstg==&c=nog0Oo5KdbY9KwTOuZ-XgZf-6-1Mq2kIpwNBzREyKUE=].


* <big>&#10004;</big> ''Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades'', Shlomit Yuval-Greenberg, Orr Tomer, Alon S. Keren, Israel Nelken and Leon Y. Deouell, Neuron, 58, pp. 429–441, 2008. [http://www.neuron.org/content/article/abstract?uid=PIIS0896627308003012 link] - Presenter: <font color="#ff0000">Paul and Tim</font>
=== E-mail List ===


* <big>&#10004;</big> ''Internally Generated Reactivation of Single Neurons in Human Hippocampus During Free Recall'', Hagar Gelbard-Sagiv, Roy Mukamel, Michal Harel, Rafael Malach, Itzhak Fried, Science, Published Online September 4, 2008. [http://www.sciencemag.org/cgi/content/short/1164685 link] - Presenter: <font color="#ff0000">Will</font>
To subscribe to the journal club email list, visit [https://calmail.berkeley.edu/manage/list/listinfo/redwood_tcn@lists.berkeley.edu link]. You will receive emails about twice a week about papers that will be covered in the next meeting.


* <big>&#10004;</big> ''Saliency Detection: A Spectral Residual Approach'', Xiaodi Hou and Liqing Zhang, in Proc. of CVPR '07, pp. 1-8, 2007. [http://bcmi.sjtu.edu.cn/~houxiaodi/papers/CVPR07.pdf link] - Presenter: <font color="#ff0000">Chetan</font>
=== Guidelines for Presenting Papers ===
 
Each person that selects a paper should present, in about 15-30 minutes:
* <big>&#10004;</big> ''The information bottleneck method'', N. Tishby, F.C. Pereira and W. Bialek, in Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing, B. Hajek and R.S. Sreenivas eds, pp. 368-377 (University of Illinois, 1999). [http://www.princeton.edu/~wbialek/our_papers/tishby+al_99.pdf link] - Presenter: <font color="#ff0000">Pierre</font>
* an executive summary
 
* an outline of the key points, ideas, or contributions
* <big>&#10004;</big> ''Evolutionary expansion and anatomical specialization of synapse proteome complexity'', R. D. Emes et al., Nature Neuroscience, vol. 11, no. 7, pp. 799-806, June 2008. [http://www.nature.com/neuro/journal/v11/n7/full/nn.2135.html link] - Presenter: <font color="#ff0000">Jeff</font>
* relevant background information
 
* a description of the key figures
* <big>&#10004;</big> ''Stability of the fittest: organizing learning through retroaxonal signals'', Ken Harris, Trends Neurosci, 31(3), pp. 130-136, 2008. [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6T0V-4RS3TBR-1&_user=4420&_coverDate=03%2F31%2F2008&_alid=770804385&_rdoc=1&_fmt=high&_orig=search&_cdi=4872&_sort=d&_docanchor=&view=c&_ct=1&_acct=C000059607&_version=1&_urlVersion=0&_userid=4420&md5=38891fcb62351e3bfa79f00214a3dbfb link] - Presenter: <font color="#ff0000">Will</font>
* what you took away from the paper
 
* some potential questions for discussion
* <big>&#10004;</big> ''Object recognition with cortex-like mechanisms'', T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber and T. Poggio, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29 (3), pp. 411-426, 2007. [http://web.mit.edu/serre/www/publications/Serre_etal_PAMI07.pdf link]- Presenter: <font color="#ff0000">Jack</font>
* you are encouraged to use whatever method to present (slides, puppets, etc.)
 
* <big>&#10004;</big> ''Nonlinear extraction of 'Independent Components' of elliptically symmetric densities using radial Gaussianization'', S. Lyu and E. P. Simoncelli, Computer Science Technical Report TR2008-911, Apr 2008. [http://www.cns.nyu.edu/pub/lcv/lyu08a.pdf link] - Presenter: <font color="#ff0000">Bruno</font>
 
* <big>&#10004;</big> ''Relating neural dynamics to neural coding'', G. Bard Ermentrout, Roberto F. Galàn and Nathaniel N. Urban, Physical Review Letters, vol. 99, no. 24, December 2007. [http://www.andrew.cmu.edu/user/rfgalan/pdf/Ermentrout_etal_PRL07.pdf link] - Presenter: <font color="#ff0000">Ariel</font>
 
* <big>&#10004;</big> ''Spatio-temporal correlations and visual signaling in a complete neuronal population'', Jonathan W. Pillow, Jonathon Shlens, Liam Paninski, Alexander Sher, Alan M. Litke, E. J. Chichilnisky, Eero P. Simoncelli, Nature (to appear), 2008. - Presenter: <font color="#ff0000">Jonathon Shlens</font>
 
* <big>&#10004;</big> ''Learning Compressed Sensing'', Yair Weiss and Hyun Sung Chang and William T. Freeman, Allerton 2007. [http://www.cs.huji.ac.il/~yweiss/allerton-final.pdf link] - Presenter: <font color="#ff0000">Pierre</font>
 
* <big>&#10004;</big> ''Sparse and shift-invariant feature extraction from non-negative data'', P. Smaragdis, B. Raj, and M.V. Shashanka, In proceedings IEEE International Conference on Audio and Speech Signal Processing, April 2008. [http://web.media.mit.edu/~paris/Paris_Smaragdis/Paris_Smaragdis_web_page_files/smaragdis-icassp2008.pdf link] - Presenter: <font color="#ff0000">Vivienne</font>
 
* <big>&#10004;</big> ''Context and hierarchy in a probabilistic image model'', Y. Jin and S. Geman, CVPR (2) 2006, pp. 2145-2152. [http://www.dam.brown.edu/people/geman/Homepage/Compositionality%20in%20computer%20vision/cvpr06_final.pdf link] - Presenter: <font color="#ff0000">Amir</font>
 
* <big>&#10004;</big> ''Entrainment of neuronal oscillations as a mechanism of attentional selection'', Peter Lakatos, George Karmos, Ashesh D. Mehta, Istvan Ulbert, Charles E. Schroeder, Science, vol. 320, no. 5872, pp. 110-113, April 2008. [http://www.sciencemag.org/cgi/content/full/320/5872/110 link] - Presenter: <font color="#ff0000">Gianluca</font>
 
* <big>&#10004;</big> ''The missing memristor found'', Dmitri B. Strukov, Gregory S. Snider, Duncan R. Stewart, R. Stanley Williams, Nature, vol. 453, pp. 80-83, May 2008. - Presenter: <font color="#ff0000">Chris</font>
 
* <big>&#10004;</big> ''80 million tiny images: a large dataset for non-parametric object and scene recognition'', A. Torralba, R. Fergus, W. T. Freeman, submitted to IEEE PAMI, October 2007. [http://people.csail.mit.edu/torralba/tmp/tiny.pdf link] - Presenter: <font color="#ff0000">Jascha</font>
 
* <big>&#10004;</big> ''Decoupling through Synchrony in Neuronal Circuits with Propagation Delays'', E. V. Lubenov and A. G. Siapas. Neuron, vol. 58, 2008, pp. 118-131. [http://www.neuron.org/content/article/abstract?uid=PIIS0896627308001281 link] - Presenter: <font color="#ff0000">Amir</font>
 
* <big>&#10004;</big> ''The role of learning in 3-D form perception'', P. Sinha and T. Poggio. Nature, vol. 384, no 6608, 1996, pp. 460-463. [http://web.mit.edu/bcs/sinha/papers/sinha_poggio_1996.pdf link] - Presenter: <font color="#ff0000">Charles </font>
 
* <big>&#10004;</big> ''Sparse Feature Learning for Deep Belief Networks'', M. Ranzato, Y. Boureau, Y. LeCun. Advances in Neural Information Processing Systems 20 (NIPS 2007). [http://www.cs.nyu.edu/~ranzato/publications/ranzato-nips07.pdf link] - Presenter: <font color="#ff0000">Jimmy</font>
 
* <big>&#10004;</big> ''Phase-of-Firing Coding of Natural Visual Stimuli in Primary Visual Cortex'', Marcelo A. Montemurro, Malte J. Rasch, Yusuke Murayama, Nikos K. Logothetis, and Stefano Panzeri. Current Biology, vol. 18, no. 5, Mar 2008, pp. 375-380. [http://www.current-biology.com/content/article/abstract?uid=PIIS0960982208001681 link] - Presenter: <font color="#ff0000"> Kilian </font>
 
* <big>&#10004;</big> ''Multisensory auditory–visual interactions during early sensory processing in humans: a high-density electrical mapping study'', Sophie Molholm, Walter Ritter, Micah M. Murray, Daniel C.Javitt, Charles E. Schroeder and John J. Foxe. Cognitive Brain Research, vol. 14, no. 1, Jun 2002, pp. 115-128. [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6SYV-453NT51-3&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=2411980aadd64b5e82e152d090c8cdbd link] - Presenter: <font color="#ff0000"> Gianluca </font>
 
* <big>&#10004;</big> ''The sleep switch: hypothalamic control of sleep and wakefulness'', Clifford B. Saper, Thomas C. Chou and Thomas E. Scammell, Trends in Neurosciences, Vol. 24, No. 12, Dec 2001. [http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6T0V-44FBS07-11&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=54f2cf21b3a8f2dd7effb8732a331506 link] - Presenter: <font color="#ff0000"> Will </font>
 
* <big>&#10004;</big> ''Sparse time-frequency representations'', T. J. Gardner and M. O. Magnasco, PNAS, vol. 103, no. 16, pp. 6094-6099, 2006. [http://www.pnas.org/cgi/content/abstract/103/16/6094 link] - Presenter: <font color="#ff0000"> Marcelo Magnasco</font>
 
* <big>&#10004;</big> ''Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication'', H. Jaeger and H. Haas, Science, Vol. 304, Issue 5667, pp. 78-80, 2004. [http://www.sciencemag.org/cgi/content/abstract/304/5667/78 link] - Presenter: <font color="#ff0000">Jascha</font>
 
* <big>&#10004;</big> ''Does spatial invariance result from insensitivity to change?'', F. A. A. Kingdom, D. J. Field and A. Olmos, Journal of Vision, 7(14):11, 1-13, Dec. 2007. [http://journalofvision.org/7/14/11/ link] - Presenter: <font color="#ff0000"> Bruno Olshausen </font>
 
* <big>&#10004;</big> ''How Behavioral Constraints May Determine Optimal Sensory Representations'', Emilio Salinas, PLoS Biology, 6:12, Dec. 2006. [http://biology.plosjournals.org/perlserv/?request=get-document&doi=10.1371/journal.pbio.0040387 link] - Presenter: <font color="#ff0000"> Lavi Secundo </font>
 
* <big>&#10004;</big> Convexity, disparity, and depth perception: internalization of natural scene statistics. Johannes Burge, Charless C. Fowlkes, Martin S. Banks. DRAFT. Presenter: <font color="#ff0000"> Johannes Burge </font>
 
* <big>&#10004;</big> The K-SVD: An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation. IEEE Trans. On Signal Processing, Vol. 54, no. 11, pp. 4311-4322, November 2006. [http://www.cs.technion.ac.il/~elad/publications/journals/2004/32_KSVD_IEEE_TSP.pdf link]  Presenter: <font color="#ff0000"> Gianluca Monaci </font>
 
* <big>&#10004;</big> Image Denoising with Nonparametric Hidden Markov Trees. J. Kivinen, E. Sudderth, and M. Jordan. ICIP 2007. [http://ssg.mit.edu/~esuddert/papers/icip07.pdf link] Presenter: <font color="#ff0000"> Jack Culpepper </font>
 
* <big>&#10004;</big> Coupling between neuronal firing, field potentials, and FMRI in human auditory cortex. Mukamel R, Gelbard H, Arieli A, Hasson U, Fried I, Malach R. Science. 2005 Aug 5;309(5736):951-4. [http://www.sciencemag.org/cgi/content/abstract/309/5736/951?maxtoshow=&HITS=10&hits=10&RESULTFORMAT=&fulltext=Coupling+between+neuronal+firing%2C+field+potentials%2C+and+FMRI+in+human+auditory+cortex.&searchid=1&FIRSTINDEX=0&resourcetype=HWCIT link] Presenter: <font color="#ff0000"> Tim Blanche </font>
 
* <big>&#10004;</big> The design and use of steerable filters. W. T. Freeman and E. H. Adelson,  IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891 - 906, September, 1991. [http://people.csail.mit.edu/billf/papers/steerpaper91FreemanAdelson.pdf link]Presenter: <font color="#ff0000"> Jimmy Wang </font>
 
* <big>&#10004;</big> Problem reduction, renormalization, and memory. Commun. Appl. Math. Comput. Sci. 1  1-27. Chorin, Alexandre J. and Stinis, Panagiotis (2006). Presenter: <font color="#ff0000"> Amir and Fritz </font>
 
* <big>&#10004;</big> Learning Lie Groups of Visual Invariance.  Xu Miao and Rajesh P.N. Rao. Neural Computation 19,2665-2693 (2007). Presenter: <font color="#ff0000"> Pierre Garrigues </font>
 
* <big>&#10004;</big> Correlation between neural spike trains increases with firing rate.  Jaime de la Rocha, Brent Doiron, Eric Shea-Brown, Kresimir Josic  & Alex Reyes. Nature 448, 802-806 (16 August 2007) [http://www.nature.com/nature/journal/v448/n7155/abs/nature06028.html link]. Presenter: <font color="#ff0000"> Chris Rozell </font>
 
* <big>&#10004;</big> Adaptation to Stimulus Contrast and Correlations during Natural Visual Stimulation. Nicholas A Lesica, Jianzhong Jin, Chong Weng, Chun-I Yeh, Daniel A Butts, Garrett B Stanley, Jose-Manuel Alonso. Neuron 2007 vol. 55 pp. 479-91. Presenter: <font color="#ff0000"> Tim Blanche </font>
 
* <big>&#10004;</big> Quest for a Stochastic Grammar of Images. Song-Chun Zhu and David Mumford. To appear in Foundations and Trends in Computer Graphics and Vision, 2007. [http://www.stat.ucla.edu/~sczhu/papers/Grammar_quest.pdf link]. Presenter: <font color="#ff0000"> Amir </font>
 
* <big>&#10004;</big> Slow feature analysis yields a rich repertoire of complex cell properties. Berkes, P. and Wiskott, L. (2005). Journal of Vision, 5(6), 579-602. [http://journalofvision.org/5/6/9/article.aspx link]. Presenter: <font color="#ff0000"> Charles Cadieu </font>
 
* <big>&#10004;</big> Unsupervised learning of image transformations. Memisevic, R. and Hinton, G. E.  Computer Vision and Pattern Recognition 2007 [http://www.cs.toronto.edu/~rfm/pubs/cvpr07.pdf link]. Presenter: <font color="#ff0000"> Jack Culpepper </font>
 
* <big>&#10004;</big> The thalamus as a monitor of motor outputs. R. W. Guillery and S. M. Sherman. Phil. Trans. R. Soc. Lond. B (2002) 357, 1809-1821. Presenter: <font color="#ff0000"> Jascha Sohl-Dickstein </font>
 
* <big>&#10004;</big> Recovering Intrinsic Images from a Single Image. Tappen, M. F., Freeman, W. T., and Adelson, E. H.. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(9): 1459 - 1472, (2005). [http://web.mit.edu/persci/people/adelson/documents/Tappen_PAMI_27-9.pdf link] Presenter: <font color="#ff0000"> Chetan Nandakumar </font>
 
* <big>&#10004;</big> N. Ay, D. Polani. Information Flows in Causal Networks. Advances in Complex Systems, submitted. Santa Fe Institute Working Paper 06-05-014. [http://www.santafe.edu/research/publications/workingpapers/06-05-014.pdf link] Presenter: <font color="#ff0000"> Joe Makin </font>
 
* <big>&#10004;</big> Der R., Hesse F., Liebscher R.: Contingent robot behavior from self-referential dynamical systems. Autonomous robots submitted. [http://www.informatik.uni-leipzig.de/~der/Veroeff/autorob.pdf link] Presenter: <font color="#ff0000"> Fritz Sommer </font>
 
* <big>&#10004;</big> Z Wang, A C Bovik and E P Simoncelli. Structural approaches to image quality assessment. Chapter 8.3 in Handbook of Image and Video Processing, 2nd Edition, ed. Alan Bovik, Academic Press, 2005. [http://www.cns.nyu.edu/pub/lcv/wang05c-preprint.pdf link] Presenter: <font color="#ff0000"> Jimmy Wang </font>
 
* <big>&#10004;</big> O. Ben-Shahar and S.W. Zucker. Geometrical Computations Explain Projection Patterns of Long Range Horizontal Connections in Visual Cortex, in Neural Computation, 16(3): 445-476, 2004. [http://www.cs.yale.edu/~shahar/Publications/NC2004.pdf link] Presenter: <font color="#ff0000"> Pierre Garrigues </font>
 
* <big>&#10004;</big> Zhaoping L. (2005) Border Ownership from Intracortical Interaction in Visual Area V2 , in NEURON, Vol. 47, 143-153 [http://www.gatsby.ucl.ac.uk/~zhaoping/prints/ZhaopingNEURON2005JournalVersion.pdf link] Presenter: <font color="#ff0000"> Paul King </font>
 
* <big>&#10004;</big> Nakayama, K. , He, Z.J. and Shimojo, S. Visual surface representation: a critical link between lower-level and higher level vision. In Kosslyn, S.M. and Osherson, D.N. Vision. In Invitation to Cognitive Science. M.I.T. Press, p. 1-70, 1995 [http://visionlab.harvard.edu/Members/Ken/Ken%20papers%20for%20web%20page/077NKHeShimojoMIT1995b.pdf  link] Presenter: <font color="#ff0000"> Jascha Sohl-Dickstein </font>
 
* <big>&#10004;</big> Sinha, P., Balas, B.J., Ostrovsky, Y., & Russell, R."Face Recognition by Humans: 19 results all computer vision researchers should know about." Proceedings of the IEEE. Vol. 94, No. 11, 1948-1962 (2006) [web.mit.edu/bcs/sinha/papers/20Results_2005.pdf link] Presenter: <font color="#ff0000"> Chetan Nandakumar </font>
 
* <big>&#10004;</big> Chandler DM, and Field DJ. "Estimates of the Information Content and Dimensionality of Natural Scenes from Proximity Distributions." Journal of the Optical Society of America, 2006 (in press) [http://redwood.psych.cornell.edu/manuscripts/chandler_field_xentropy_2006.pdf link] Presenter: <font color="#ff0000"> Paul Ivanov </font>
 
* <big>&#10004;</big> Z. Tu, X. Chen, A.L. Yuille, and S.C. Zhu. "Image Parsing: Unifying Segmentation, Detection, and Recognition".  Proceedings of ICCV 2003. [http://www.stat.ucla.edu/~yuille/pubs/impaired/iccv_parsing.pdf  link] Presenter: <font color="#ff0000"> Jimmy Wang </font>
 
* <big>&#10004;</big> E. Schneidman, M. Berry, R. Segev and W. Bialek. "Weak pairwise correlations imply strongly correlated network states in a neural population". Nature 440, 1007-1012 (20 April 2006) [http://www.nature.com/nature/journal/v440/n7087/full/nature04701.html link] Presenter: <font color="#ff0000"> Pierre Garrigues </font>
 
* <big>&#10004;</big> S. Ullman, S. Soloviev. "Computation of Pattern Invariance in Brain-like Structures". Neural Networks 1999. [http://www.wisdom.weizmann.ac.il/~shimon/papers/NN12_99.pdf link] Presenter: <font color="#ff0000"> Charles Cadieu </font>
 
* <big>&#10004;</big> P. Bak, C. Tang, and K. Wiesenfeld. "Self-Organized Critically: An Explanation of 1/f Noise". Physical Review Letters, July 1987. Presenter: <font color="#ff0000"> Kilian Koepsell </font>
 
* <big>&#10004;</big> A. Hyvarinen. "Estimation of Non-Normalized Statistical Models by Score Matching". Journal of Machine Learning Research 6 (2005) 695-709. Presenter: <font color="#ff0000"> Jascha Sohl-Dickstein </font>
 
* <big>&#10004;</big> M. Ranzato, C.S. Poultney, S. Chopra and Y. LeCun. "Efficient Learning of Sparse Overcomplete Representations with an Energy-Based Model". Advances in Neural Information Processing Systems 19, in Scholkopf et al. (eds), MIT Press, Cambridge, MA, 2007. Presenter: <font color="#ff0000"> Pierre Garrigues </font>
 
* <big>&#10004;</big> Liam Paninski, Jonathan Pillow and Eero Simoncelli. Maximum  Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model. Neural Computation, 2004. Presenter: <font color="#ff0000"> Amir </font>
 
* <big>&#10004;</big> Randall C. O'Reilly. Biologically Based Computational Models of High-Level Cognition. Science Oct. 2006. Presenter: <font color="#ff0000"> Charles Cadieu </font>
 
* <big>&#10004;</big> Todorov, E. and Jordan, M. I.  Optimal feedback control as a theory of motor coordination. Nature Neuroscience 5, 1226-1235, 2002.
 
* <big>&#10004;</big> Asari, H., Pearlmutter, B. A. and Zador, A. M. Sparse Representations for the Cocktail Party Problem. The Journal of Neuroscience, July 12, 2006.
 
* <big>&#10004;</big> Hinton, G. E. and Salakhutdinov, R. R.  Reducing the dimensionality of data with neural networks. Science, Vol. 313. no. 5786, pp. 504 - 507, 28 July 2006.
 
* <big>&#10004;</big> P. Dayan, Image, Frames, and Connectionist Hierarchies. Neural Computation 18, 2293-2319 (2006)
 
* <big>&#10004;</big> T. Blaschke, P. Berkes and L. Wiskott, What Is the Relation Between Slow Feature Analysis and Independent Component Analysis? Neural Computation 18, 2495-2508 (2006)
 
* <big>&#10004;</big> T.J. Gardner, and M.O. Magnasco, Sparse time-frequency representations    PNAS 103: 6094-6099, April 18, 2006 [http://www.pnas.org/cgi/reprint/103/16/6094.pdf paper]
 
* <big>&#10004;</big> B.L. McNaughton, F.P. Battaglia, O. Jensen, E.I. Moser and M.B. Moser, Path integration and the neural basis of the 'cognitive map'. Nature Reviews Neuroscience 7, 663-678 (August 2006) [http://www.nature.com/nrn/journal/v7/n8/full/nrn1932.html paper]
 
* <big>&#10004;</big> Karklin, Lewicki. A Hierarchical Bayesian Model for Learning Nonlinear Statistical Regularities in Nonstationary Natural Signals. Neural Computation. 2005;17:397-423. [http://www.mitpressjournals.org/doi/abs/10.1162/0899766053011474 paper] [http://video.google.com/videoplay?docid=-5115453018099427284&q=msri MSRI talk]
 
* <big>&#10004;</big> Perspectives: Jose-Manuel Alonso, Neurons Find Strength Through Synchrony in the Brain, Science, 16 June 2006, Vol. 312. no. 5780, pp. 1604 - 1605 [http://www.sciencemag.org/cgi/content/short/312/5780/1604 link]
 
* <big>&#10004;</big> Randy M. Bruno and Bert Sakmann, Cortex Is Driven by Weak but Synchronously Active Thalamocortical Synapses, Science, 16 June 2006, Vol. 312. no. 5780, pp. 1622 - 1627 [http://www.sciencemag.org/cgi/content/short/312/5780/1622 link]
 
* <big>&#10004;</big> David J. Foster and Matthew A. Wilson, Reverse replay of behavioural sequences in hippocampal place cells during the awake state, Nature 440, 680-683 (30 March 2006) [http://www.nature.com/nature/journal/v440/n7084/pdf/nature04587.pdf link]
 
* <big>&#10004;</big> Guetig, Sompolinsky. The Tempotron: a neuron that learns spike timing-based decisions. Nature Neuroscience 2006; 9:420-428. [http://www.nature.com/neuro/journal/v9/n3/pdf/nn1643.pdf link]
 
* <big>&#10004;</big> E. Smith and M. S. Lewicki, Efficient Auditory Coding, Nature, 439 (7079), 2006. [http://www.nature.com/nature/journal/v439/n7079/abs/nature04485.html link]
 
: News and Views: DeWeese and Zador, "Neurobiology: Efficiency measures". [http://www.nature.com/nature/journal/v439/n7079/full/439920a.html link]
 
* <big>&#10004;</big> D. Y. Tsao, W. A. Freiwald, R. B. H. Tootell, M. S. Livingstone, A Cortical Region Consisting Entirely of Face-Selective Cells, Science 3 February 2006; Vol. 311. no. 5761, pp. 670 - 674. [http://www.sciencemag.org/cgi/content/full/311/5761/670 link]
 
: Perspectives: Kanwisher, "What's in a Face?". [http://www.sciencemag.org/cgi/content/full/311/5761/617 link]
 
*  <big>&#10004;</big> Harris Nover, Charles H. Anderson, and Gregory C. DeAngelis. A Logarithmic, Scale-Invariant Representation of Speed in Macaque Middle Temporal Area Accounts for Speed Discrimination Performance. J. Neurosci., Oct 2005; 25: 10049 - 10060 [http://www.jneurosci.org/cgi/content/full/25/43/10049?maxtoshow=&HITS=10&hits=10&RESULTFORMAT=&author1=anderson&searchid=1&FIRSTINDEX=0&resourcetype=HWCIT link]
 
* <big>&#10004;</big> Randy M. Bruno and Bert Sakmann, Cortex Is Driven by Weak but Synchronously Active Thalamocortical Synapses, Science, 16 June 2006, Vol. 312. no. 5780, pp. 1622 - 1627 [http://www.sciencemag.org/cgi/content/short/312/5780/1622 link]
 
: Perspectives: Jose-Manuel Alonso, Neurons Find Strength Through Synchrony in the Brain, Science, 16 June 2006, Vol. 312. no. 5780, pp. 1604 - 1605 [http://www.sciencemag.org/cgi/content/short/312/5780/1604 link]
 
* <big>&#10004;</big> C Whitney & P Cornelissen (2005).  Letter-position encoding and dyslexia.  Journal of Research in Reading 28, 274-301. [http://www.cs.umd.edu/~shankar/cwhitney/Papers/JRR.pdf paper]
 
==== Early Work ====
 
* <big>&#10004;</big> K. A. C. Martin, The Pope and grandmother−a frog's-eye view of theory, Nature Neuroscience  3, 1169 (2000) [http://www.nature.com/neuro/journal/v3/n11s/full/nn1100_1169.html link]
 
* <big>&#10004;</big> Lettvin, Maturana, McCulloch, Pitts, "What the Frog's Eye Tells the Frog's Brian" [http://jerome.lettvin.info/WhatTheFrogsEyeTellsTheFrogsBrain.pdf link]
 
* <big>&#10004;</big> Barlow HB (1972) Single Neurons and Sensation: A neuron doctrine for perceptual psychology. Perception 1, 371-394. [http://redwood.berkeley.edu/~amir/pdf/Barlow1972.pdf link]
 
* Marvin Minsky, Steps Toward Artificial Intelligence [http://portal.acm.org/citation.cfm?id=216408.216442&coll=GUIDE&dl=GUIDE link]
 
* McCulloch and Pitts, “A logical calculus of the ideas immanent in nervous activity” (1943) [http://portal.acm.org/citation.cfm?coll=GUIDE&dl=GUIDE&id=104377 link]
 
* Marr, selection from Vision; Artificial Intelligence—a personal view, by David Marr [http://scholar.google.com/url?sa=U&q=https://dspace.mit.edu/handle/1721.1/5776%3Fmode%3Dsimple link]
 
* Readings from Dartmouth Conf. 1956 proceedings
* Rosenblatt, Frank (1962).  Principles of neurodynamics.  New York: Spartan.  Cf. Rumelhart, D.E., J. L. McClelland and the PDP Research Group (1986).  Parallel Distributed Processing vol. 1&2.  Cambridge: MIT. [http://scholar.google.com/scholar?hl=en&lr=&q=rosenblatt+principles+of+neurodynamics&btnG=Search link]
 
* "Making a Mind Versus Modeling the Brain: Artificial Intelligence Back at a Branchpoint" (with H. Dreyfus),Daedulus, Winter 1988 [http://portal.acm.org/citation.cfm?id=63323.66521 link]
 
==== Coding ====
 
* <big>&#10004;</big> Kreiman, G. Neural Coding: Computational and Biophysical Perspectives, Physics of Life Reviews, 2, 71-102, 2004. [http://dx.doi.org/10.1016/j.plrev.2004.06.001 link]
 
* <big>&#10004;</big> Pouget, A, Dayan, P & Zemel, RS (2000). Information processing with population codes. Nature Reviews Neuroscience, 1 , 125-132. [http://www.nature.com/nrn/journal/v1/n2/full/nrn1100_125a_fs.html link]
 
* <big>&#10004;</big> E. Smith and M. S. Lewicki, Efficient Auditory Coding, Nature, 439 (7079), 2006. [http://www.nature.com/nature/journal/v439/n7079/abs/nature04485.html link]
 
: News and Views: DeWeese and Zador, "Neurobiology: Efficiency measures" [http://www.nature.com/nature/journal/v439/n7079/full/439920a.html link]
 
* Olshausen BA, Field DJ. Sparse Coding of Sensory Inputs.  Curr Op in Neurobiology, 14: 481-487 (2004). [http://redwood.psych.cornell.edu/papers/current-opinion.pdf link]
 
* Coding and computation with neural spike trains. W Bialek & A Zee, J. Stat. Phys. 59, 103–115 (1990). [http://www.princeton.edu/~wbialek/our_papers/bialek+zee_90.pdf link]
 
* Selection from: Spikes: Exploring the Neural Code.  F Rieke, D Warland, R de Ruyter van Steveninck & W Bialek (MIT Press, Cambridge, 1997). [http://melvyl.cdlib.org/F/?func=find-b&base=CDL90&request=0-262-18174-6&find_code=020 link]
 
* <big>&#10004;</big> H. Nover, C. H. Anderson, and G. C. DeAngelis, A Logarithmic, Scale-Invariant Representation of Speed in Macaque Middle Temporal Area Accounts for Speed Discrimination Performance, J. Neurosci., Oct 2005; 25: 10049 - 10060 [http://www.jneurosci.org/cgi/reprint/25/43/10049 link]
 
* <big>&#10004;</big> Ray Singh and Chris Eliasmith, Higher-Dimensional Neurons Explain the Tuning and Dynamics of Working Memory Cells, J. Neurosci. 2006;26 3667-3678 [http://www.jneurosci.org/cgi/reprint/26/14/3667 link]
 
==== Cortical Microcircuit/Universal Cortical Algorithm ====
 
* <big>&#10004;</big> Vernon Mountcastle (1978), "An Organizing Principle for Cerebral Function: The Unit Model and the Distributed System", The Mindful Brain (Gerald M. Edelman and Vernon B. Mountcastle, eds.) Cambridge, MA: MIT Press [http://redwood.berkeley.edu/~amir/pdf/Mountcastle78.pdf link]
 
* <big>&#10004;</big> Rodney J. Douglas, Kevan A.C. Martin, Neural Circuits of the Neocortex, Annual Review of Neuroscience 2004 27, 419-451 [http://arjournals.annualreviews.org/doi/full/10.1146/annurev.neuro.27.070203.144152 link]
 
* <big>&#10004;</big> Selection from: Hawkins, J., On Intelligence (Chapter 6) [http://redwood.berkeley.edu/~amir/pdf/HawkinsChap6.pdf link]
 
* <big>&#10004;</big> Henry Markram, The Blue Brain Project, Nature Neuroscience, 7:153-160, 2006. [http://www.nature.com/nrn/journal/v7/n2/pdf/nrn1848.pdf link]
 
* Douglas RJ, Martin KAC Whitteridge D. (1989) A canonical microcircuit for neocortex. Neural Computation 1: 480-488. [http://scholar.google.com/scholar?hl=en&lr=&q=douglas+martin+whitteridge+neural+comput+1989&btnG=Search link] (the [http://www.archive.org/details/redwood_center_inaugural_symposium_08 related talk] at the Redwood symposium)
 
* Cross-modal plasticity in cortical development: differentiation and specification sensory cortex, by Mriganka Sur, Sarah L. Pallas and Anna W. Roe. [http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=1694329&dopt=Citation link]
 
* Poggio, T. and E. Bizzi.  Generalization in Vision and Motor Control, Nature, Vol. 431, 768-774, 2004. [http://www.nature.com/nature/journal/v431/n7010/abs/nature03014.html link]
 
* Marr D, "A Theory for Cerebral Neocortex", Proc Roy Soc London(B), 176, 161-234, 1970. [http://adsabs.harvard.edu/abs/1970RSPSB.176..161M link]
 
==== Feedback, Hierarchical Organization, Generative Models ====
 
* <big>&#10004;</big> David Mumford, Neuronal Architectures for Pattern-theoretic Problems, in "Large-Scale Neuronal Theories of the Brain", C.Koch & J.Davis, editors, MIT Press, 1994, pp.125-152. [http://redwood.berkeley.edu/~amir/pdf/Neuronal_Mumford.pdf link]
 
* <big>&#10004;</big> RPN Rao. Bayesian inference and attention in the visual cortex. Neuroreport 16(16), 1843-1848, 2005. [http://www.cs.washington.edu/homes/rao/nreport_bayes_atten05.pdf link]
 
* TS Lee, D Mumford Hierarchical Bayesian inference in the visual cortex, Journal of the Optical Society of America A, 2003 [http://scholar.google.com/url?sa=U&q=http://www.dam.brown.edu/people/mumford/Papers/JOSALeeMumford.pdf link]
 
* Felleman, DJ and Van Essen, DC (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1, 1-47. [http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=1822724&dopt=Abstract link]
 
==== Manifold Learning ====
 
* <big>&#10004;</big> Richard Durbin & Graeme Mitchison, A dimension reduction framework for understanding cortical maps, Nature 343, 644 - 647 (15 February 1990) [http://www.nature.com/nature/journal/v343/n6259/abs/343644a0.html link]
 
* <big>&#10004;</big> Tal Kenet, Dmitri Bibitchkov, Misha Tsodyks, Amiram Grinvald and Amos Arieli, Spontaneously emerging cortical representations of visual attributes, Nature 425, 954-956 (30 October 2003) [http://www.nature.com/nature/journal/v425/n6961/full/nature02078.html link]
 
* Selection from: Self-Organizing and Associative Memory, T Kohonen - Japanese translation 2nd Edition, Splinger-Verlag Tokyo, 1994 [http://citeseer.ist.psu.edu/context/2930/0 link]
 
* <big>&#10004;</big> JB Tenenbaum, V de Silva, JC Langford, A Global Geometric Framework for Nonlinear Dimensionality Reduction, Science, 2000 [http://www.sciencemag.org/cgi/content/full/290/5500/2319 link]
 
* <big>&#10004;</big> ST Roweis, LK Saul, Nonlinear Dimensionality Reduction by Locally Linear Embedding, Science, 2000 [http://www.sciencemag.org/cgi/content/full/290/5500/2323 link]
 
* Nicholas V. Swindale, Doron Shoham, Amiram Grinvald, Tobias Bonhoeffer & Mark Hübener, Visual cortex maps are optimized for uniform coverage, Nature Neuroscience  3, 822 - 826 (2000) [http://www.nature.com/neuro/journal/v3/n8/full/nn0800_822.html link]
 
Background reading on SOMs
* Neural Computation and Self-Organizing Maps - An Introduction, by Helge Ritter, Thomas Martinetz, and Klaus Schulten, Addison-Wesley, New York, 1992, [http://www.ks.uiuc.edu/Services/Class/PHYS498TBP/spring2002/neuro_4.pdf Kohonen's Network Model] [http://www.ks.uiuc.edu/Services/Class/PHYS498TBP/spring2002/neuro_book.html Contents]
 
==== Plasticity, Hebbian Learning ====
 
* Dan, Y. and Poo, M.-m. (2004). Spike timing-dependent plasticity of neural circuits. Neuron 44, 23-30 [http://www.ling.sinica.edu.tw/paper-Mu-ming%2520Poo-2.pdf link]
 
* Abbott LF, Nelson SB. (2000) Synaptic plasticity: taming the beast. Nat Neurosci. 3 Suppl:1178-83. [http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=11127835&dopt=Abstract link]
 
* P. Foldiak, Forming sparse representations by local anti-Hebbian learning, Biological Cybernetics, vol. 64, pp. 165-170, 1990. [http://www.st-andrews.ac.uk/~pf2/FoldiakSparseBC90.pdf link]
 
* M. Tsodyks, Spike-timing-dependent synaptic plasticity–The long road towards understanding neuronal mechanisms Trends in Neuroscience, 2002. [http://dx.doi.org/10.1016/S0166-2236(02)02294-4 link]
 
* Saudargienne A, Porr B, and Worgotter F. How the shape of pre- and postsynaptic signals can influence STDP: a biophysical model. Neural Comp 16: 595–625, 2004. [http://neco.mitpress.org/cgi/content/abstract/16/3/595 link]
 
* Seung, HS (2000) Half a century of Hebb. Nat. Neurosc. Suppl: 1166. [http://www.nature.com/cgi-taf/DynaPage.taf?file=/neuro/journal/v3/n11s/full/nn1100_1166.html link]
 
* H. S. Seung. Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40, 1063-1073 (2003). [http://hebb.mit.edu/people/seung/papers/Neuron18Dec03.pdf link]
 
* Hinton, G. E. and Sejnowski, T. J. (1986), Learning and relearning in Boltzmann machines. In Rumelhart, D. E. and McClelland, J. L., editors, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press, Cambridge, MA. [http://portal.acm.org/citation.cfm?coll=GUIDE&dl=GUIDE&id=104291 link]
 
==== Oscillations ====
 
* Gray, CM (1999) The temporal correlation hypothesis of visual feature integration: still alive and well. Neuron. 1999, 24(1):31-47, 111-25. Review. [http://scholar.google.com/url?sa=U&q=http://lifesci.rutgers.edu/~auerbach/Gray%2520binding.pdf link]
 
* Neuron Special Issue on Oscillations, 1999, 24(1) [http://www.sciencedirect.com/science?_ob=IssueURL&_tockey=%23TOC%237054%231999%23999759998%23575347%23FLA%23&_auth=y&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=fcf1d593bba077aaec2c4f34adbe071d link]
 
==== Associative Memory ====
 
* <big>&#10004;</big> J Hopfield. Neural Networks and Physical Systems with Emergent Collective Computational Abilities. PNAS, 79:2554-2558 (1982) [http://www.pnas.org/cgi/content/abstract/79/8/2554 link]
** David MacKay, Information Theory, Inference, and Learning Algorithms, Cambridge Univ. Press, 2003. [http://www.inference.phy.cam.ac.uk/mackay/itprnn/ps/504.520.pdf Chapter 42 (Hopfield networks)]
 
* <big>&#10004;</big> S. Fusi, P.J. Drew, and L.F. Abbott, Cascade Models of Synaptically Stored Memories, Neuron 2005 45: 599-611. [http://www.sciencedirect.com/science?_ob=MImg&_imagekey=B6WSS-4FH5K0X-H-1&_cdi=7054&_user=4420&_orig=search&_coverDate=02%2F17%2F2005&_qd=1&_sk=999549995&view=c&wchp=dGLbVlz-zSkWz&md5=1b45b90c5fb16f945ba490ba48503de7&ie=/sdarticle.pdf link]
 
* G. Palm. On the storage capacity of an associative memory with randomly distributed storage elements. Biol. Cybernetics. 36:19-31 (1980). [http://www.springerlink.com/link.asp?id=wp7q375127415311 link]
 
* Selection from: Self-Organizing and Associative Memory, T Kohonen - Japanese translation 2nd Edition, Splinger-Verlag Tokyo, 1994
 
==== Models of Invariance ====
 
* Olshausen BA, Anderson CH, Van Essen DC (1993). A Neurobiological Model of Visual Attention and Invariant Pattern Recognition Based on Dynamic Routing of Information, The Journal of Neuroscience, 13(11), 4700-4719. [http://redwood.berkeley.edu/bruno/papers/ link]
 
* K Fukushima, Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, Biological Cybernetics (Historical Archive), Volume 36, Issue 4, Apr 1980, Pages 193 - 202 [http://www.springerlink.com/link.asp?id=r6g5w3tt54528137 link]
 
* <big>&#10004;</big> P. Foldiak, Learning invariance from transformation sequences, Neural Computation, vol. 3, pp. 194-200, 1991. [http://www.st-andrews.ac.uk/~pf2/FoldiakInvarianceLearningNC91.pdf link]
 
* <big>&#10004;</big> L Wiskott. Slow Feature Analysis: Unsupervised Learning of Invariances. Neural Computation. 2002;14:715-770. [http://redwood.berkeley.edu/~cadieu/pdf/WiskottSejnowski-SlowFeature.pdf link]
 
==== Active Perception-sensorimotor loops ====
 
* <big>&#10004;</big> D. Philipona, J.K.O'Regan & J.-P. Nadal. Is there something out there? Inferring space from sensorimotor dependencies. Neural Computation, 2003, 15, 9, 2029-2050. [http://nivea.psycho.univ-paris5.fr/Philipona/space.pdf link]
 
* <big>&#10004;</big> Philipona, D., O Regan, J.K., Nadal, J.-P. and Coenen, O. J.-M. D. Perception of the structure of the physical world using multimodal unknown sensors and effectors. Advances in Neural Information Processing Systems, 16, 2004. [http://www.csl.sony.fr/downloads/papers/2004/philipona-04b.pdf link]
 
* Churchland P, Ramachandran VS, Sejnowski TJ. Large-Scale Neuronal Theories of the Brain: Chapter 2, Critique of Pure Vision, 1994. [http://cnl.salk.edu/~terry/PDF/PureVision.94.pdf link]
 
* Oregan JK, Noe A. A sensorimotor account of vision and visual consciousness, BBS (2001) 24:939-1031. [http://ist-socrates.berkeley.edu/~noe/oregan.noe.pdf link]
 
====Birdsong====
 
* <big>&#10004;</big> Anthony Leonardo & Michale S. Fee.  Ensemble Coding of Vocal Control in Birdsong.  The Journal of Neuroscience, January 19, 2005, 25(3):652-661.  [http://www.jneurosci.org/cgi/reprint/25/3/652 link (Warning: 27.7 MB .pdf)]
 
* <big>&#10004;</big> Troyer TW, Bottjer SW. Birdsong: models and mechanisms. Curr Opin Neurobiol. 2001 Dec;11(6):721-6. [http://redwood.berkeley.edu/~cadieu/pdf/TroyerBottjer_Birdsong_CurrOpinNeuro01.pdf link]
 
==== Theories of the Ventral Stream ====
 
* <big>&#10004;</big> Ullman, S. (1995). Sequence-seeking and counter streams: A computational model for bi-directional information flow in the visual cortex. Cerebral Cortex, 5(1) 1-11. [http://redwood.berkeley.edu/~cadieu/pdf/UllmanCerCor95.pdf link]
 
* <big>&#10004;</big> Riesenhuber, M., and T. Poggio.  Models of Object Recognition,  Nature Neuroscience, 3 Supp., 1199-1204, 2000. [http://www.nature.com/neuro/journal/v3/n11s/pdf/nn1100_1199.pdf link]
 
* Riesenhuber, M. and T. Poggio. How Visual Cortex Recognizes Objects: The Tale of the Standard Model. In: The Visual Neurosciences, (Eds. L.M. Chalupa and J.S. Werner), MIT Press, Cambridge, MA, Vol. 2, 1640-1653, 2003. [http://cbcl.mit.edu/projects/cbcl/publications/ps/max-vis-cortex-03.pdf link]
 
* Rolls,E.T. (1997) A neurophysiological and computational approach to the functions of the temporal lobe cortical visual areas in invariant object recognition. Chapter 9, pp. 184-220 in Computational and Psychophysical Mechanisms of Visual Coding, eds. M.Jenkin and L.Harris. Cambridge University Press: Cambridge. [http://www.cns.ox.ac.uk/publications.html link]
 
====Sleep====
* <big>&#10004;</big> Crick, Francis, and Graeme Mitchison. "The Function of Dream Sleep." Nature 304, (14 July 1983): 111-114. [http://redwood.berkeley.edu/~cadieu/pdf/CrickMitchisonDreamSleep1983.pdf link]
 
* <big>&#10004;</big> Sutherland GR, McNaughton B., Memory trace reactivation in hippocampal and neocortical neuronal ensembles., Curr Opin Neurobiol. 2000 Apr;10(2):180-6 [http://redwood.berkeley.edu/~cadieu/pdf/SutherlandMcNaughtonMemoryReactivation1999.pdf link]
 
==== Theories of Hippocampus ====
 
* Becker, S. (2005) "A computational principle for hippocampal learning and neurogenesis". Hippocampus 15(6):722-738. [http://www.science.mcmaster.ca/Psychology/sb.html link]
 
* Leutgeb, S., Leutgeb, J.K., Moser, M.-B., and Moser, E.I. (2005). Place cells, spatial maps and the population code for memory. Current Opinion in Neurobiology, 15, 738-746. [http://www.cbm.ntnu.no/publications link]
 
* [http://www.bris.ac.uk/synaptic/research/projects/memory/spatialmem.htm place cells]
 
* Hasselmo, M.E. and McClelland, J.L. (1999) Neural models of memory. Curr. Opinion Neurobiol. 9: 184-188. [http://people.bu.edu/hasselmo/HasselmoMcClelland.pdf link]
 
==== Motor System ====
 
* Körding, KP. and Wolpert, D. (2004) Bayesian Integration in Sensorimotor Learning, Nature 427:244-247. [http://www.koerding.com/pubs/koerdingNature2004.pdf link]
 
*  <big>&#10004;</big> Georgopoulos AP. Neuron. 1994 Aug;13(2):257-68. New concepts in generation of movement. [http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=8060612&dopt=Abstract link]
 
* <big>&#10004;</big> Todorov E Direct cortical control of muscle activation in voluntary arm movements: a model. (2000) Nature Neuroscience 3(4): 391-398 [http://cogsci.ucsd.edu/~todorov/papers/mi.pdf link]
 
* Todorov E. On the role of primary motor cortex in arm movement control (2003) In Progress in Motor Control III, ch 6, pp 125-166, Latash and Levin (eds), Human Kinetics [http://cogsci.ucsd.edu/~todorov/papers/MotorCortex.pdf link]
 
* Scott, S.H. (2004) Optimal feedback control and the neural basis of volitional motor control. Nature Reviews Neuroscience 5:532-546. [http://limb.biomed.queensu.ca/publications/optimal_feedback_control_and_the_neural_basis.pdf link]
 
==== Dynamics ====
 
See [[Dynamics Reading Club]] site

Revision as of 21:23, 19 September 2010

Topics in Computational Neuroscience

Summer 2010

  • [September 23] Bullier, Jean. "What is Fed Back?" in 23 Problems in Systems Neuroscience. [1]
  • [June 10]
    • Jarzynski, Nonequilibrium work relations: foundations and applications. [2]
    • Crooks, Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian Systems. [3]
    • Crooks, Beyond Boltzmann-Gibbs statistics: Maximum entropy hyperensembles out of equilibrium [4]
  • [May 20] Truccolo et al., Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes [5]

Spring 2010

  • [May 13] A review of active learning (no paper).
  • [Apr 29] Ranzato and Hinton, Modeling Pixel Means and Covariances Using Factorized Third-Order Boltzmann Machines [6]
  • [Apr 22] Boureau et al., Learning Mid-Level Features For Recognition [7]
  • [Apr 15] Neghaban et al., A unified framework for the analysis of regularized $M$-estimators.[8]
  • [Apr 6] Lucke et al., Occlusive components analysis. [9]
  • [Mar 25] Bießmann et al., Decision-related activity in sensory neurons reflects more than a neuron's causal effect.[10]
  • [Mar 18] Itskov and Abbott, Pattern Capacity of a Perceptron for Sparse Discrimination. [11]
  • [Mar 11] Nienborg and Cumming, Decision-related activity in sensory neurons reflects more than a neuron's causal effect.[12]
  • [Feb 18] Masse et al., Olfactory Information Processing in Drosophila. [13]
  • [Feb 11] Yaghoobi et al., Dictionary Learning for Sparse Approximations with the Majorization Method. [14]
  • [Feb 4] Ecker et al., Decorrelated Neuronal Firing in Cortical Microcircuits. [15]
  • [Feb 4] Renart et al., The Asynchronous State in Cortical Circuits. [16]
  • [Jan 28] Recht et al., Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization. [17]

Fall 2009

  • [Dec 3] Kolgin et al., Frequency of gamma oscillations routes flow of information in the hippocampus. [18]
  • [Nov 17] Graham, Chandler, Field. Can the theory of ‘‘whitening’’ explain the center-surround properties of retinal ganglion cell receptive fields? [19]
  • [Nov 12] Lighthill and AI community debate, 1973. [20]
  • [Oct 29, Nov 5] George, Hawkins, Towards a Mathematical Theory of Cortical Micro-circuits. [21]
  • [Oct 22]: Berkes et al., A Structured Model of Video Reproduces Primary Visual Cortical Organisation.[22]
  • [Oct 15]: Petreanu et al., The subcellular organization of neocortical excitatory connections. [23]
  • [Oct 15]: Arenz et al. The contribution of single synapses to sensory representation in vivo. [24]
  • [Oct 1,8]: Kobilarov et al., Lie Group Integrators for Animation and Control of Vehicles.[25]

Past TCN Papers

Suggestion Board

Time and Location

1:10-2:00pm usually every Thursday in the Redwood Center (508-20 Evans).

Overview

This journal club is aimed at graduate students from the neuroscience program, neuroscience related life sciences, as well as students from engineering, physics, and math programs with an interest in a computational approach to studying the brain. It provides a broad survey of literature from theoretical and computational neuroscience. Readings will combine both seminal works and recent theories. We meet for one session each week.

It is possible to take this seminar for credit. If you would like to do so, please mention during journal club.

You can also contact the club organizer at [26].

E-mail List

To subscribe to the journal club email list, visit link. You will receive emails about twice a week about papers that will be covered in the next meeting.

Guidelines for Presenting Papers

Each person that selects a paper should present, in about 15-30 minutes:

  • an executive summary
  • an outline of the key points, ideas, or contributions
  • relevant background information
  • a description of the key figures
  • what you took away from the paper
  • some potential questions for discussion
  • you are encouraged to use whatever method to present (slides, puppets, etc.)