Difference between revisions of "VS298: Reading"

From RedwoodCenter
Jump to navigationJump to search
(23 intermediate revisions by the same user not shown)
Line 36: Line 36:
 
==== 30 Sep ====
 
==== 30 Sep ====
 
* Foldiak, P. [http://connes.berkeley.edu/~amir/vs298/foldiak90.pdf Forming sparse representations by local anti-Hebbian learning]. Biol. Cybern. 64, 165-170 (1990).
 
* Foldiak, P. [http://connes.berkeley.edu/~amir/vs298/foldiak90.pdf Forming sparse representations by local anti-Hebbian learning]. Biol. Cybern. 64, 165-170 (1990).
* Olshausen BA, Field DJ Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, 381: 607-609. (1996)
+
* Olshausen BA, Field DJ. [http://connes.berkeley.edu/~amir/vs298/bruno-nature.pdf Emergence of simple-cell receptive field properties by learning a sparse code for natural images], Nature, 381: 607-609. (1996)
 +
 
 +
==== 2 Oct ====
 +
Optional readings that covers material in lecture in greater depth:
 +
 
 +
* Rozell, Johnson, Baraniuk, Olshausen. [http://connes.berkeley.edu/~amir/vs298/rozell-sparse-coding-nc08.pdf Sparse Coding via Thresholding and Local Competition in Neural Circuits], Neural Computation 20, 2526–2563 (2008).
 +
 
 +
* Simoncelli, Olshausen. [http://connes.berkeley.edu/~amir/vs298/simoncelli01-reprint.pdf Natural Image Statistics and Neural Representation], Annu. Rev. Neurosci. 2001. 24:1193–216.
 +
 
 +
* Smith, Lewicki. [http://connes.berkeley.edu/~amir/vs298/smith-lewicki-nature06.pdf Efficient auditory coding], Nature Vol 439 (2006).
 +
 
 +
==== 7 Oct ====
 +
 
 +
A handout on sparse coding and on 'ICA', something we haven't yet discussed:
 +
* [http://connes.berkeley.edu/~amir/vs298/sparse-coding-handout.pdf Sparse coding and 'ICA' ]
 +
 
 +
Dayan and Abbott has a nice section on sparse coding in Chapter 10. This is on the syllabus for unsupervised learning already, but you may want to focus on section 10.3 and 10.4.
 +
 
 +
Here is a link to [http://www.dsp.ece.rice.edu/cs/ Compressive Sensive Resources] at Rice. It has an enormous number of recent papers related to compressed sensing and sparse coding.
 +
 
 +
==== 9 Oct ====
 +
 
 +
Here are a list of references for David Zipser's talk: [http://connes.berkeley.edu/~amir/vs298/backpropneuralref.pdf pdf]. David also suggested the following chapter in an upcoming book by Thomas J. Anastasio: [http://connes.berkeley.edu/~amir/vs298/zipserchap10.pdf pdf (waiting for approval to post)]
 +
 
 +
==== 14 Oct ====
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/miller89.pdf Ocular dominance column development: Analysis and simulation] by Miller, Keller and Stryker.
 +
* [http://connes.berkeley.edu/~amir/vs298/durbin-mitchison.pdf A dimension reduction framework for understanding cortical maps] by R. Durbin and G. Mitchison.
 +
* [http://connes.berkeley.edu/~amir/vs298/horton05.pdf The cortical column: a structure without a function] by Jonathan C. Horton and Daniel L. Adams
 +
 
 +
Here are some additional links to papers mentioned in lecture. Optional reading:
 +
 
 +
- Gary Blasdel, [http://connes.berkeley.edu/~amir/vs298/blasdel1992.pdf Differential Imaging of Ocular Dominance and Orientation Selectivity in Monkey Striate Cortex], J Neurosci, 1992.  Another source of many of nice images are in the galleries on Amiram Grinvald's site: [http://www.weizmann.ac.il/brain/grinvald/]
 +
 
 +
- From Clay Reid's lab, [http://www.nature.com/nature/journal/v433/n7026/abs/nature03274.html Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex]. Make sure you look at the supplementary material and videos on their web site (seems partly broken) [http://reid.med.harvard.edu/movies.html].
 +
 
 +
==== 16 Oct ====
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/tenenbaum-manifold.pdf A Global Geometric Framework for Nonlinear Dimensionality Reduction ], Tenenbaum et al., Science 2000.
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/roweis-saul-manifold.pdf Nonlinear Dimensionality Reduction by Locally Linear Embedding], Roweis and Saul, Science 2000.
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/carlsson-ijcv08.pdf On the Local Behavior of Spaces of Natural Images], Carlsson et al., Int J Comput Vis (2008) 76: 1–12.
 +
 
 +
Additional reading:
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/webster-face-adaptation.pdf Adaptation to natural facial categories], Michael A. Webster, Daniel Kaping, Yoko Mizokami & Paul Duhamel, Nature, 2004.
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/leopold.pdf Prototype-referenced shape encoding revealed by high-level aftereffects], David A. Leopold, Alice J. O’Toole, Thomas Vetter and Volker Blanz, Nature, 2001.
 +
 
 +
==== 21 Oct ====
 +
 
 +
* Handout on [http://connes.berkeley.edu/~amir/vs298/attractor-networks.pdf Attractor neural networks]
 +
* [http://connes.berkeley.edu/~amir/vs298/hopfield82.pdf original Hopfield (1982) paper]
 +
* HKP Chapters 2 and 3
 +
 
 +
==== 23 Oct ====
 +
 
 +
* [http://connes.berkeley.edu/~amir/vs298/hopfield84.pdf Hopfield (1984) paper]
 +
* [http://connes.berkeley.edu/~amir/vs298/zhang96.pdf Kechen Zhang paper on bump circuits]
 +
* [http://connes.berkeley.edu/~amir/vs298/olshausen-etal93.pdf Olshausen, Anderson & Van Essen, dynamic routing circuit model]

Revision as of 21:03, 23 October 2008

For each lecture, we also have a list of optional reading corresponding to ideas discussed in lecture. You may read these if you are interested in the particular topic: Optional Reading

2 Sep

04 Sep

Optional reading for more background:

16 Sep

  • Handout on supervised learning in single-stage feedforward networks

18 Sep

  • Handout on supervised learning in multi-layer feedforward networks - "backpropagation"
  • Y. LeCun, L. Bottou, G. Orr, and K. Muller (1998) "Efficient BackProp," in Neural Networks: Tricks of the trade, (G. Orr and Muller K., eds.).
  • NetTalk demo

23 Sep

25 Sep

  • HKP Chapter 9

30 Sep

2 Oct

Optional readings that covers material in lecture in greater depth:

7 Oct

A handout on sparse coding and on 'ICA', something we haven't yet discussed:

Dayan and Abbott has a nice section on sparse coding in Chapter 10. This is on the syllabus for unsupervised learning already, but you may want to focus on section 10.3 and 10.4.

Here is a link to Compressive Sensive Resources at Rice. It has an enormous number of recent papers related to compressed sensing and sparse coding.

9 Oct

Here are a list of references for David Zipser's talk: pdf. David also suggested the following chapter in an upcoming book by Thomas J. Anastasio: pdf (waiting for approval to post)

14 Oct

Here are some additional links to papers mentioned in lecture. Optional reading:

- Gary Blasdel, Differential Imaging of Ocular Dominance and Orientation Selectivity in Monkey Striate Cortex, J Neurosci, 1992. Another source of many of nice images are in the galleries on Amiram Grinvald's site: [1]

- From Clay Reid's lab, Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex. Make sure you look at the supplementary material and videos on their web site (seems partly broken) [2].

16 Oct

Additional reading:

21 Oct

23 Oct