TCN: Difference between revisions

Latest revision as of 07:40, 13 November 2017

Topics in Computational Neuroscience

For ideas about some interesting papers to discuss have look here TCN Paper Ideas

Overview

This journal club is aimed at graduate students from the neuroscience program, neuroscience related life sciences, as well as students from engineering, physics, and math programs with an interest in a computational approach to studying the brain. It provides a broad survey of literature from theoretical and computational neuroscience. Readings will combine both seminal works and recent theories. We meet for one session each week.

It is possible to take this seminar for credit. If you would like to do so, please mention during journal club.

If you have questions, please email the club organizer (2017) Eric Dodds

Time and Location

(Fall 2017) 4pm-5pm almost every Wednesday in the Redwood Center conference room (560 Evans). Please sign up to the email list (below) for announcements on changes to meeting dates.

Guidelines for Presenting Papers

Each person that selects a paper should present, in about 15-30 minutes:

an executive summary
an outline of the key points, ideas, or contributions
relevant background information
a description of the key figures
what you took away from the paper
some potential questions for discussion
you are encouraged to use whatever method to present (slides, puppets, etc.)

E-mail List

To subscribe to the journal club email list, send an email to redwood_tcn+subscribe@lists.berkeley.edu. You will receive emails twice a week about papers that will be covered in the next meeting.

Fall 2017

[December 13] Ryan Zarcone
[December 6] Danny Weitekamp
[November 29] Eric Weiss
[November 15] Bruno Olshausen - Sara Sabour, Nicholas Frosst, and Geoffrey E. Hinton. "Dynamic Routing Between Capsules." [1]
[November 8] Charles Frye - Jeffrey Pennington and Yasaman Bahri. "Geometry of Neural Network Loss Surfaces via Random Matrix Theory." [2]
[November 1] Shariq Mobin - Matthew James Johnson et al. "Composing graphical models with neural networks for structured representations and fast inference." [3]
[October 25] Vasha DuTell - Marius Pachitariu and Maneesh Sahani. "Visual motion computation in recurrent neural networks." [4]
[October 18] Pratik Sachdeva - Ashok Litwin-Kumar & Brent Doiron. "Slow dynamics and high variability in balanced cortical networks with clustered connections." [5]
[October 4] Mayur Mudigonda - Ingmar Kanitscheider & Ila Fiete. "Training recurrent networks to generate hypotheses about how the brain solves hard navigation problems." [6]
[September 27] Spencer Kent - Jiajun Wu, Joshua B. Tenenbaum, and Pushmeet Kohli. "Neural Scene De-rendering" [7]
[September 13] Guy Isely - Saurabh Gupta, James Davidson, Sergey Levine, Rahul Sukthankar, and Jitendra Malik. "Cognitive Mapping and Planning for Visual Navigation." [8]

Summer 2017

[August 22] Dylan Paiton - Honghao Shan, Lingyun Zhang, and Garrison Cottrell. "Recursive ICA" [9]
[August 8] Guy Isely - Max Jaderberg, Wojciech Marian Czarnecki, Simon Osindero, Oriol Vinyals, Alex Graves, David Silver, and Koray Kavukcuoglu. "Decoupled Neural Interfaces using Synthetic Gradients." [10]
[August 1] Alex Anderson - Rahul G. Krishnan, Uri Shalit, and David Sontag. "Structured Inference Networks for Nonlinear State Space Models." [11]
[July 25] Canceled
[July 18] Canceled for CRCNS course
[July 11] Canceled for CRCNS course
[July 4] Holiday
[June 27] Everyone - Ravid Shwartz-Ziv and Naftali Tishby. "Opening the Black Box of Deep Neural Networks via Information." [12]
[June 20] Sean Mackesey - R. Ellen Ambrose, Brad E. Pfeiffer, and David J. Foster. "Reverse replay of hippocampal place cells is uniquely modulated by changing reward." Neuron 91.5 (2016): 1124-1136.
[June 13] Neha Wadia - Dmitriy Aronov, Rhino Nevers, and David W. Tank. "Mapping of a non-spatial dimension by the hippocampal–entorhinal circuit." [13]
[June 6] Charles Garfinkle - Plant neurobiology [14][15] [16]
[May 30] Jesse Livezey - Readings on (ab)uses of machine learning in policing [17] [18] [19] etc

Spring 2017

[May 16] Various? - Redwood NIPS submissions 2017
[May 9] James Arnemann - van den Oord et al. (2016) Wavenet: A Generative Model for Raw Audio. [20]
[May 2] Pratik Sachdeva - Ashok Litwin-Kumar, Kameron Decker Harris, Richard Axel, Haim Sompolinsky, and L.F. Abbott. (2017) Optimal Degrees of Synaptic Connectivity.[21]
[Apr 25] Kata Slama - József Fiser, Pietro Berkes, Gergő Orbán, Máté Lengyel. (2010) Statistically optimal perception and learning: from behavior to neural representations [22]
[Apr 18] Dylan Paiton - Matthew Zeiler & Rob Fergus. (2012) Differentiable Pooling for Hierarchical Feature Learning. [23]
[Apr 11] Eric Weiss - Discussion on computational complexity and regularization in machine learning
[Apr 4] Brian Cheung - Jun-Yan Zhu, Taesung Park, Philip Isola, and Alexei A. Efros. (2017) "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks." [24]
[Mar 14] Ryan Zarcone - Johannes Ballé, Valero Laparra, and Eero P. Simoncelli. (2017) "End-to-end Optimized Image Compression." ICLR 2017. [25]
[Mar 7] Eric Dodds - Wiktor Młynarski and Josh McDermott. (2017) "Learning Mid-Level Auditory Codes from Natural Sound Statistics." [26]
[Jan 19] Kata Slama - Jiefeng Jiang (江界峰), Christopher Summerfield and Tobias Egner. (2016) "Visual Prediction Error Spreads Across Object Features in Human Visual Cortex." [27]

Fall 2016

[Dec 12] James Golden - JR Golden et al (2016). Conjectures Regarding the Nonlinear Geometry of Visual Neurons. [28]
[Dec 05] Sean Mackesey - Kraus et al (2013). Hippocampal "Time Cells": Time Versus Path Integration [29]
[Nov 28] Chris Warner - Lazer et al. (2010). The coevolution of networks and political attitudes. [30]
[Nov 21] Kohta Ishikawa - Do & Vetterli (2003). Framing pyramids. [31]
[Nov 14] Charles Frye - Wainwright & Jordan. (2008). Graphical models, exponential families, and variational inference. [32]
[Nov 07] Petr Jezek - Eslami et al (2016). Attend, Infer, Repeat: Fast Scene Understanding with Generative Models. [33]
[Nov 04] Yubei Chen - Wainwright & Jordan. (2008). Graphical models, exponential families, and variational inference. [34]
[Oct 24] Ryan Zarcone - Weiss et al (2007). Learning Compressed Sensing. [35]
[Oct 17] Neha Wadia - Rajan et al (2016). Recurrent network models of sequence generation and memory. [36]
[Oct 10] Eric Weiss - Tutorial: Hyperdimensional Representations for Scene Analysis.
[Oct 03] Vasha Dutell - Dong & Atick (1995). Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus. [37]
[Sep 26] Jesse Livezey - Cheung et al (2016). The auditory representation of speech sounds in human motor cortex. [38]
[Sep 19] Brian Cheung - Discussion: The Biological Plausibility of Backpropagation.
[Sep 12] Alex Anderson - Jaderberg et al (2016). Decoupled neural interfaces using synthetic gradients. [39]
[Sep 05] Charles Garfinkle - Palmer et al (2015). Predictive information in a sensory population. [40]

Summer 2016

[August 31] Spencer Kent - Fu et al (2016). Occlusion boundary detection via deep exploration of context. [41]
[August 17] Paxon Frady - Glasser, M. F., et al. (2016) A Multi-modal parcellation of human cerebral cortex. [42] and Huth, Alexander G., et al. (2016) Natural speech reveals the semantic maps that tile human cerebral cortex. [43]
[August 10] Mayur Mudigonda - Salimans, Tim, Diederik P. Kingma, and Max Welling (2015). Markov chain Monte Carlo and variational inference: Bridging the gap. [44]
[August 3] Pratik Sachdeva - Moreno-Bote, Rubén, et al. (2014). Information-limiting correlations. [45]
[July 26] Shariq Mobin - Karklin, Yan, and Eero P. Simoncelli (2011). Efficient coding of natural images with a population of noisy linear-nonlinear neurons.[46]
[July 20] Sean Mackesey - Buzsáki, György (2010). Neural syntax: cell assemblies, synapsembles, and readers. [47]
[July 13] Katarina Slama and Vasha DuTell - Akam, Thomas, and Dimitri M. Kullmann (2010). Oscillations and filtering networks support flexible routing of information. [48]
[July 6] Karl Zipser - Bojarski, Mariusz, et al (2016). End to End Learning for Self-Driving Cars. [49]
[June 29] Ian Robertson - Hermans, M., & Van Vaerenbergh, T. (2015). Towards Trainable Media: Using Waves for Neural Network-Style Training. [50]
[June 22] Group Discussion - Jonas, Eric, and Konrad Kording. (2016) Could a neuroscientist understand a microprocessor? [51]
[June 15] Spencer Kent, Mayur Mudigonda, and Eric Weiss - Kulkarni, Tejas D., et al (2015). Picture: A probabilistic programming language for scene perception. [52]
[June 8] Jesse Livezey - Bornschein, Jörg, Marc Henniges, and Jörg Lücke (2013). Are V1 simple cells optimized for visual occlusions? A comparative study. [53]
[June 1] Yubei Chen - Y. Karklin & M. S. Lewicki (2003). Learning higher-order structures in natural images. [54]
[May 25] Eric Dodds - Y. Karklin, C. Ekanadham, & E.P. Simoncelli (2012). Hierarchical spike coding of sound. [55]

Spring 2016

[May 11] NIPS exchange

[May 04] Chris Warner - MEJ Newman (2006). Finding Community Structure in Networks using the Eigenvectors of Matrices [56]

[Apr 27] Mr. (Alex) Anderson - E Ahissar, A Arieli (2012). Seeing Via Miniature Eye Movements- A Dynamic Hypothesis for Vision [57]

[Apr 20] Charles Frye, Ryan Zarcone, Brian Cheung - RM Neal, GE Hinton (1998). A View of the EM Algorithm That Justifies Incremental, Sparse, and Other Variants [58]

[Apr 13] Kohta Ishikawa - C Zetzsche, U Nuding (2009). Nonlinear and Higher-Order Approaches to the Encoding of Natural Scenes [59]

[Apr 06] Spencer Kent - IJ Goodfellow, J Pouget-Abadie, M Mirza, B Xu, D Warde-Farley, Y Bengio (2014). Generative Adversarial Nets [60]

[Mar 30] Guy Isley - R Chaudhuri, A Bernacchia, XJ Wang (2014). A Diversity of Localized Timescales in Network Activity [61]

[Mar 23] Brian Cheung - DJ Rezende, S Mohamed, I Danihelka, K Gregor, D Wierstra (2016). One-Shot Generalization in Deep Generative Models [62]

[Mar 16] Yubei Chen - A Beck, M Teboulle (2009). A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [63]

[Mar 09] Sean Mackesey - P Fries (2015). Rhythms for Cognition: Communication Through Coherence [64]

[Mar 02] Charles Garfinkle - BB Ujfalussy, JK Makara, T Branco, M Lengyel (2015). Dendritic Nonlinearities are Tuned for Efficient Spike-Based Computations in Cortical Circuits [65]

[Feb 24] Eric Weiss - TS Lee, D Mumford (2003). Hierarchical Bayesian Inference in the Visual Cortex [66]

[Feb 17] Paxon Frady - C Eliasmith et al. (2012). A Large-Scale Model of the Functioning Brain [67]

[Feb 10] Cancelled - EECS Colloquium

[Feb 03] Charles Frye - L Aitchison, M Lengyel (2014). The Hamiltonian Brain [68]

[Jan 21] Jesse Livezy and Andrew Berger - S Shapero, M Zhu, J Hasler, C Rozell (2014). Optimal Sparse Approximations with Integrate and Fire Neurons [69]

[Jan 14] Daniel Toker - AK Seth, AB Barrett, L Barnett (2011). Causal Density and Integrated Information as Measures of Conscious Level [70]

Fall 2015

[Dec 17] Charles Frye - BM Lake, R Salakhutdinov, JB Tenenbaum (2015). Human-Level Concept Learning Through Probabilistic Program Induction [71]

[Dec 03] Omer Hazon - D Soudry, I Hubara, R Meir (2014). Expectation Backpropagation [72]

[Nov 26] Thanksgiving break

[Nov 19] Eric Dodds - EC Smith, MS Lewicki (2006). Efficient Auditory Coding [73]

[Nov 12] Vasha Dutell - H Hosoya, A Hyvarinen (2015). A Hierarchical Statistical Model of Natural Images Explains Tuning Properties in V2 [74]

Summer 2014

[June 19] Buzsaki & Mizuseki (2014). The log-dynamic brain: how skewed distributions affect network operations. [75]

[June 12] Hukushima & Nemoto (1996). Exchange Monte Carlo method and application to spin glass simulations. [76]

[June 5] Shi & Griffiths (2009). Neural implementation of hierarchical bayesian inference by importance sampling. [77]

[May 29] Petersen & Crochet (2013). Synaptic computation and sensory processing in neocortical layer 2/3. [78]

[May 22] Laje R, Buonomano DV (2013) Robust timing and motor patterns by taming chaos in recurrent neural networks. Nat. Neurosci. 16:925-933 [79]

Spring 2014

[Jan 20] Sutskever 2012- Training Recurrent Neural Networks. [80]

Fall 2013

[Sep 18] Guillery & Sherman 2010 - Branched thalamic afferents: What are the messages that they relay to the cortex? [81]

Summer 2013

[July 10] Curto & Itskov 2008 - Cell Groups Reveal Structure of Stimulus Space [82]

Spring 2013

[Apr 8] Burak et al. 2009 - Accurate Path Integration in Continuous Attractor Network Models of Grid Cells [83] [84]

[Mar 27] Sreenivasan et al. 2011 - Grid cells generate an analog error-correcting code for singularly precise neural computation. [85]

[Mar 20] Killian et al. - A map of visual space in the primate entorhinal cortex [86]

[Mar 13] Doyle et al. 2011 - Architecture, constraints and behavior [87]

[Mar 6] Grady 2006 - Random Walks for Image Segmentation [88]

[Feb 27] Todorov 2012 - Parallels between sensory and motor information processing [89]

[Feb 13] Sohl-Dickstein 2012 - The Natural Gradient by Analogy to Signal Whitening, and Recipes and Tricks for its Use [90]

[Feb 06] Girosi 1998 - An Equivalence Between Sparse Approximation and Support Vector Machines [91][92]

[Jan 30] Zipser et al. 1996 - Contextual Modulation in Primary Visual Cortex [93]

Ayzenshtat et al. 2012 - Population Response to Natural Images in the Primary Visual Cortex Encodes Local Stimulus Attributes and Perceptual Processing [94]

[Jan 23] Gillenwater et al. 2012 - Near-Optimal MAP Inference for Determinantal Point Processes [95] [96]

[Jan 08] Cathart-Harris et al. 2012 - Neural correlates of the psychedelic state as determined by fMRI studies with psilocybin [97]

Fall 2012

[Aug 22] Maass et al. - Liquid State Computing [98] [99]

[Aug 29] Salakhutdinov & Hinton 2012 - An Efficient Learning Procedure for Deep Boltzmann Machines [100]

[Sep 05] Coates & Ng 2011 - An Analysis of Single-Layer Networks in Unsupervised Feature Learning [101]

[Sep 12] Quiroga 2012 - Concept Cells: The Building Blocks of Declarative Memory Functions [102]

[Oct 10] Moira & Bialek 2011 - Are Biological Systems Poised at Critcality? [103]

[Oct 17] Newman 2005 -Power laws, Pareto distributions and Zipfʼs law. [104]

[Nov 28] Todorov 2004 -Optimality Principles in Sensorimotor Control. [105]

@@ Line 30: / Line 30: @@
 ===Fall 2017===
 * [December 13] <font color="##ff0000">Ryan Zarcone</font>
-* [December 6] <font color="##ff0000">James Arnemann</font>
+* [December 6] <font color="##ff0000">Danny Weitekamp</font>
 * [November 29] <font color="##ff0000">Eric Weiss</font>
 * [November 15] <font color="##ff0000">Bruno Olshausen</font> - Sara Sabour, Nicholas Frosst, and Geoffrey E. Hinton. "Dynamic Routing Between Capsules." [https://arxiv.org/abs/1710.09829]