Difference between revisions of "EE 599 Graph Signal Processing"

From WikiBiron
m (Lectures)
m
Line 46: Line 46:
 
* '''Lectures''' Tuesday and Thursday, 3:30-4:50pm, GFS 220
 
* '''Lectures''' Tuesday and Thursday, 3:30-4:50pm, GFS 220
 
* '''Office hours''' Tuesday and Thursday, 5-6pm, EEB 436, and by appointment.
 
* '''Office hours''' Tuesday and Thursday, 5-6pm, EEB 436, and by appointment.
* '''Midterm 1''' TBD, in class
+
* '''Midterm''' , 10/31/13 in class
* '''Midterm 2''' TBD, in class  
 
 
* '''Final''' There will be no final exam
 
* '''Final''' There will be no final exam
  
 
== Grading ==
 
== Grading ==
Each midterm will account for 30% of the grade. The remaining 40% will be based on  a project. The final project report will be due on Dec 14, 2012. Project presentations will be on Dec 10, 2012.
+
Class participation and homework (20%), Midterm (40%), Project (40%). The final project reports will be due on Dec 13, 2013.  
 +
 
 +
== Material Covered (Subject to Change) ==
 +
*Week 1: Introduction -- Why Graph Signal Processing: concepts, applications and
 +
challenges
 +
*Week 2 Introduction to graph concepts -- Linear algebra review
 +
*Week 3 Spectral graph theory -- Orthogonal transforms review
 +
*Week 4 Frequency interpretation -- Nodal Theorems
 +
*Week 5 Graph filtering -- Vertex and Spectral interpretations
 +
*Week 6 Advanced Topic 1: Shift invariance, localization and
 +
uncertainty principles
 +
*Week 7 Advanced Topic 2: Downsampling
 +
*Week 8 Advanced Topic 3: Wavelets
 +
*Week 9 Advanced Topic 4: Multiresolution and graph approximation
 +
*Week 10 Advanced Topic 5: Directed Graphs ---  Midterm
 +
*Week 11 Application 1: Image Processing
 +
*Week 12 Application 2: Sensor Networks
 +
*Week 13 Application 3: Machine Learning
 +
*Week 14 Application 4: Finite State Machines
 +
*Week 15  Project Discussions and Presentations
 +
 
 +
== Texbooks ==
 +
'''Recommended:'''
 +
*
 +
 
  
 
== Lectures ==
 
== Lectures ==
Line 85: Line 108:
 
*Lecture 25 (12/5/13)
 
*Lecture 25 (12/5/13)
  
== Texbooks ==
 
'''Required:'''
 
* Martin Vetterli and Jelena Kovacevic, Wavelets and Subband Coding, Prentice Hall, 1995. This textbook is now available electronically at http://www.waveletsandsubbandcoding.org
 
* Matlab Wavelet Toolbox, This toolbox is available on the student computer accounts.
 
  
'''Recommended:'''
 
* Gilbert Strang and Truong Q. Nguyen, Wavelets and Filter Banks, Wellesley-Cambridge Press, 1995
 
* Stephane Mallat, A Wavelet Tour of Signal Processing: The Sparse Way, 3rd Ed., Academic Press - Elsevier, 2009
 
* P. P. Vaidyanathan, Multirate Systems and Filter Banks , Prentice Hall, 1993
 
 
== Material Covered (Subject to Change) ==
 
* '''Weeks 1 and 2''' Introduction and Motivation. Signal representation using bases. Hilbert spaces. Orthogonal, bi-orthogonal basis and overcomplete expansions. Example: representing finite energy continuous signals using Haar basis. Example of construction of Haar basis
 
* '''Week 3''' Bases for discrete signals. Finite and infinite dimensional spaces.
 
* '''Week 4''' Overcomplete expansions. Searching for the best representation. Matching pursuits and variations. Compressed sensing.
 
* '''Weeks 5 and 6''' Multirate signal processing. Filterbanks and discrete wavelet transforms. Time domain, frequency domain and polyphase domain representations.
 
* '''Week 7 and 8''' 2-Channel orthogonal filterbanks. Iterated filterbanks. Bi-orthogonal filterbanks. Lifting factorizations. Multichannel filterbanks. Modulated filterbanks.
 
* '''Weeks 9 and 10''' Multidimensional wavelets. Edgelets, bandlets, ridgelets and other extensions. Lifting for video representation.
 
* '''Week 11''' Continuous time wavelets. Series expansions of continuous signals. Haar, Sinc, Meyer, Daubechies and Spline wavelets. Mallat algorithm.
 
* '''Weeks 12, 13, 14 and 15''' Applications. Compression. Classification. Graphics. Class Projects.
 
  
 
== Projects ==
 
== Projects ==
* Project requirements:
+
* Individual project requirements: TBD
** Projects should be done individually.
 
** Each project must involve using the wavelet transform as a tool. A signal is analyzed/classified, etc by computing its wavelet transform and then the required task (e.g. denoising/classification) is performed in the transform domain.
 
** The Matlab toolbox or C libraries can be used for the project. C libraries are available at [http://www.geoffdavis.net/dartmouth/wavelet/wavelet.html Dartmouth] and [http://math.rutgers.edu/%7Eojanen/wavekit/ Rutgers].
 
** Whichever method is used, the source code will have to be made available along with the project report (only for the routines that you write, which could call those available in matlab or C.)
 
*Reporting requirements: a final report and a class presentation.
 
* [http://sipi.usc.edu/~ortega/Projects596.html Project descriptions and references]
 
* Test data for the projects
 
* [http://sipi.usc.edu/~ortega/ee596_wavelet_toolbox.html Software packages]
 
  
Demos on the web
 
* [http://www.andrew.cmu.edu/user/jelenak/ Jelena Kovacevic's webpage] contains numerous pointers to books, projects, demos, applets, etc.
 
* [http://www.math.sc.edu/%7Esjohnson/wvlib/demo/ Wavelet Library Demo at South Carolina]
 
* [http://cm.bell-labs.com/cm/ms/who/wim/cascade/ Bell Labs: Wim Sweldens' Wavelet Cascade Applet]
 
* [http://bigwww.epfl.ch/demo/fractsplines/demoprep.html Biomedical Group at EPFL - Fractional Splines Demo]
 
* [http://infolab.stanford.edu/IMAGE/ SIMPLIcity Content Based Image Retrieval - Search]
 
* [http://www.surveillance-video.com/wavelet-feb-2010.html Wavelet Resources]
 
  
 
== Statement for Students with Disabilities ==
 
== Statement for Students with Disabilities ==

Revision as of 17:51, 6 August 2013

EE 599, Graph Signal Processing, Fall 2013

Course Description: Theory and applications of emerging tools for signal processing on graphs, including a review of spectral graph theory and newly developed ideas filtering, downsampling, multiresolution decompositions and wavelet transforms"

Prerequisites: EE 483, Introduction to Digital Signal Processing and EE 441, Applied Linear Algebra for Engineering, or equivalent courses. Please note that the course will assume some knowledge of standard DSP concepts as well as of some basic linear algebra. If you took these two courses some time ago it would be a good idea to review some of the key material early in the semester

Background: Graphs have long been used in a wide variety of problems, such analysis of social networks, machine learning, network protocol optimization, decoding of LDPCs or image processing. Techniques based on spectral graph theory provide a "frequency" interpretation of graph data and have proven to be quite popular in many of these applications. In the last few years, a growing amount of work has started extending and complementing spectral graph techniques, leading to the emergence of "Graph Signal Processing" as a broad research field. A common characteristic of this recent work is that it considers the data attached to the vertices as a "graph-signal" and seeks to create new techniques (filtering, sampling, interpolation), similar to those commonly used in conventional signal processing (for audio, images or video), so that they can be applied to these graph signals.

Goals: In this class we provide an overview of this emerging area. The course is aimed at graduate students who have already completed basic coursework in the general areas of signal processing, communications and controls. We start with a review of core concepts, including a review of relevant linear algebra and signal processing concepts. This will be followed by a discussion of advanced topics, focusing on how well established concepts in signal processing are being extended to graph signals (most of this work has taken place in the last 10 years). Finally, we will study specific applications of graph signal processing methods.

Instructor

Antonio Ortega

Signal and Image Processing Institute
Department of Electrical Engineering
University of Southern California
3740 McClintock Ave., EEB 436
Los Angeles, CA 90089-2564

Tel: (213) 740-2320
Fax: (213) 740-4651
Email: antonio DOT ortega AT sipi DOT usc DOT edu

Schedule

  • Lectures Tuesday and Thursday, 3:30-4:50pm, GFS 220
  • Office hours Tuesday and Thursday, 5-6pm, EEB 436, and by appointment.
  • Midterm , 10/31/13 in class
  • Final There will be no final exam

Grading

Class participation and homework (20%), Midterm (40%), Project (40%). The final project reports will be due on Dec 13, 2013.

Material Covered (Subject to Change)

  • Week 1: Introduction -- Why Graph Signal Processing: concepts, applications and
challenges 
  • Week 2 Introduction to graph concepts -- Linear algebra review
  • Week 3 Spectral graph theory -- Orthogonal transforms review
  • Week 4 Frequency interpretation -- Nodal Theorems
  • Week 5 Graph filtering -- Vertex and Spectral interpretations
  • Week 6 Advanced Topic 1: Shift invariance, localization and

uncertainty principles

  • Week 7 Advanced Topic 2: Downsampling
  • Week 8 Advanced Topic 3: Wavelets
  • Week 9 Advanced Topic 4: Multiresolution and graph approximation
  • Week 10 Advanced Topic 5: Directed Graphs --- Midterm
  • Week 11 Application 1: Image Processing
  • Week 12 Application 2: Sensor Networks
  • Week 13 Application 3: Machine Learning
  • Week 14 Application 4: Finite State Machines
  • Week 15 Project Discussions and Presentations

Texbooks

Recommended:


Lectures

  • Detailed plan to be updated in coming days.
  • Lecture 1 (8/27/13)
    • Introduction
  • Lecture 2 (8/29/13)
  • Lecture 3 (9/3/13)
  • Lecture 4 (9/5/13)
  • Lecture 5 (9/10/13)
  • Lecture 6 (9/12/13)
  • No lecture on 9/17/13
  • Lecture 7 (9/19/13)
  • Lecture 8 (9/24/13)
  • Lecture 9 (9/26/13)
  • Lecture 10 (10/1/13)
  • Lecture 11 (10/3/13)
  • Lecture 12 (10/8/13)
  • Lecture 13 (10/10/13)
  • Lecture 14 (10/15/13)
  • Lecture 15 (10/17/13)
  • Lecture 16 (10/22/13)
  • Lecture 17 (10/24/13)
  • No lecture on 10/29/13
  • Midterm (10/31/13)
  • Lecture 18 (11/5/13)
  • Lecture 19 (11/7/13)
  • Lecture 20 (11/12/13)
  • Lecture 21 (11/14/13)
  • Lecture 22 (11/19/13)
  • Lecture 23 (11/21/13)
  • Lecture 24 (12/3/13)
  • Lecture 25 (12/5/13)


Projects

  • Individual project requirements: TBD


Statement for Students with Disabilities

Any student requesting academic accommodations based on a disability is required to register with Disability Services and Programs (DSP) each semester. A letter of verification for approved accommodations can be obtained from DSP. Please be sure the letter is delivered to me (or to TA) as early in the semester as possible. DSP is located in STU 301 and is open 8:30 a.m.--5:00 p.m., Monday through Friday. The phone number for DSP is (213) 740-0776.


Statement on Academic Integrity

USC seeks to maintain an optimal learning environment. General principles of academic honesty include the concept of respect for the intellectual property of others, the expectation that individual work will be submitted unless otherwise allowed by an instructor, and the obligations both to protect oneís own academic work from misuse by others as well as to avoid using anotherís work as oneís own. All students are expected to understand and abide by these principles. Scampus, the Student Guidebook, contains the Student Conduct Code in Section 11.00, while the recommended sanctions are located in Appendix A http://www.usc.edu/dept/publications/SCAMPUS/gov/

Students will be referred to the Office of Student Judicial Affairs and Community Standards for further review, should there be any suspicion of academic dishonesty. The Review process can be found at http://www.usc.edu/student-affairs/SJACS/.