# Teaching

## ECE 6502/BME 6550: Inference methods (Spring 2017)

In this course, we focus on statistical inference techniques and their applications. Inference allows us to learn about unobserved quantities from observed data based on a probability model. For example, we can infer the evolutionary relationships between organisms based on their genomic sequence data and a probability model of evolutionary changes. We will consider both frequentist and Bayesian methods, but will focus on the latter which aims to combine existing information with new observations in a statistically consistent manner. A main component of the course is computational methods that make possible Bayesian analysis of large datasets, which are common in many engineering and scientific disciplines, including machine learning, artificial intelligence, computational biology, and statistical physics.

**Structure:** The first two thirds of the course will consist of lectures. In the last third, enough time will be devoted to project presentations and the rest will be instructor lectures.

**Activities:** The homework will consist of problems and programming excersises. There will also be a final course project which will either involve data analysis of a real dataset to gain new insights or explores developing new inference approaches.

**Grading:** Homework 15%, Midterm 20%, Final project 30%, Final exam (take home) 35%.

**Prerequisites:** Standard linear algebra and calculus; Probability theory (briefly reviewed); A basic understanding of molecular biology is helpful but not necessary.

**Notes and Assignments:**

- Assignment 1: HTML, IPython notebook; Due date 2/1/2017
- Notes on Probability

### Syllabus

- Review of probability
- Random variables & processes
- Markov chains and Perron-Frobenius theory
- Hidden Markov models

- Frequentist inference methods
- Maximum likelihood
- Hypothesis testing
- Point estimation methods and intervals
- Applications to phylogenetics

- Introduction to Bayesian methods
- The Bayesian approach
- Single-parameter models
- Multiparameter models
- Hierarchical models

- Computational approaches to Bayesian inference
- Monte-Carlo Markov chains
- Expectation-maximization
- Variational inference

- Hidden Markov models
- Three problems: evaluation, decoding, and inference
- Gapped sequence alignment, Gene finding, Protein classification

- Information theory and inference in computational biology:
- Introduction to Information theory
- Source coding and compression of biological sequences
- Stochastic approximation and sequence evolution
- Constrained codes and models of DNA as language

### References

- Gelman, Bayesian Data Analysis
- MacKay, Information Theory, Inference, and Learning Algorithms
- Gascuel, Mathematics of Evolution and Phylogeny

## ECE 6505: ECE Seminar Series, Fall 2016

## Probability with Engineering Applications

This is an undergraduate probability course geared towards electrical and computer engineering students. I taught this course while I was a Ph.D. candidate in the ECE department at UIUC in the Summer of 2012.

My students rated my teaching effectiveness 5/5 in the course feedback forms, along with these very encouraging comments.

In this course, I gave the homework sets along with their solutions. The students were asked to solve the problems on their own and then check their solutions. They were tested by quizzes that were very similar to the homework problems.