MCS-265: Theory of Computation (Spring 2016)

Overview

This course covers the basic mathematical methodology of the theory of computation. We will study various computing models and explore their capabilities and limitations. We will study computability and unsolvability of problems. Specifically we will learn about languages and grammars, finite automata, regular expressions, pushdown automata, Turing machines, nondeterminism, undecidability, NP-completeness, problem reduction, and basic theory of computational complexity. Applications to hardware design, pattern matching, parsing, and other real-world problems will be discussed.

Course objectives

Upon successful completion of this course, you should be able to

Prerequisite

MCS-228: Proofs in Mathematics and Computer Science, or MCS-236: Graph Theory. Specifically, you should

Text

Michael Sipser, Introduction to the Theory of Computation, 3rd Edition, 2012.

The following books are recommended for further reading. They are available from the library and from me.

Homework

There will be 6 problem sets. Homeworks are due at the start of class on the due date. However, you may submit your solution several times before the official due date. I will take a quick look at your work and give as much feedback as possible as to whether you are on the right track. To get fast response and maximum benefit from these early submissions, I strongly suggest you meet with me one on one to discuss your answer. You are allowed (even encouraged) to cooperate on homework problems. However, all answers must be entirely in your own words. If you work as a team or receive help from a classmate, acknowledge it. Acknowledgment should appear at the top of your problem solution. Homework writeups should follow the homework guidelines. With each problem set, I may assign extra credit problems. You can safely ignore them, especially when you are still struggling with the regular homework problems. Extra credit problems are intended for those who need challenge beyond what the regular homework offers. They will be graded strictly.

Late homework policy

No late homework will be accepted.

Exams

There will be two intra-term exams and a final exam. Exams will be in-class, closed-book, and closed-notes. Computers and mobile devices are not allowed. You may, however, use a single notebook-sized sheet of paper with hand-written notes for reference. Both sides of the sheet may be used. You must work individually; no cooperation or help is allowed.

Grading

The homework, the two intra-term exams, and the final exam are worth 40%, 30%, and 30% of your total grade, respectively. If you earn more than 85% of the possible points, you will receive an A, more than 80% for an A-, more than 75% for a B+ and down by 5 percentage points each to the lowest passing grade of more than 40 for a D. There is no curve, although I reserve the right to adjust your grade at the end of the course. Grade adjustment will be based on class participation, extra credit problem work (if any), and my perception of your effort to learn.

Topical outline

We will cover chapters 0, 1, 2, 3, 4, 5, and 7 of the text book. Following is a broad outline of the topics.

  1. Regular languages
    1. Models: deterministic and nondeterministic finite automata, regular expressions, equivalence of models
    2. Properties: closure properties, decision properties, pumping lemma
  2. Context-free languages
    1. Context-free grammars (CFGs), derivations, parse trees
    2. Pushdown automata, definition, equivalence with CFGs
    3. Properties: normal forms, closure properties, decision properties, pumping lemma
  3. Decidable languages
    1. Turing machines: definition, techniques for constructing Turing machines, extensions, restrictions, Turing computability, Church-Turing thesis, universal Turing machines
    2. Undecidability: halting problem and others
    3. Reducibility
  4. Computational Complexity: resource-bounded computation, polynomial time, space, NP-completeness of satisfiability, polynomial-time reduction, other NP-complete problems

Disability Accommodations

Gustavus Adolphus College is committed to ensuring the full participation of all students in its programs. If you have a documented disability (or you think you may have a disability of any nature) and, as a result, need reasonable academic accommodation to participate in class, take tests or benefit from the College's services, then you should speak with the Disability Services staff, for a confidential discussion of your needs and appropriate plans. Course requirements cannot be waived, but reasonable accommodations may be provided based on disability documentation and course outcomes. Accommodations cannot be made retroactively; therefore, to maximize your academic success at Gustavus, please contact Disability Services as early as possible. Disability Services (http://www.gustavus.edu/advising/disability/) is located in the Academic Support Center. Disability Services Coordinator, Kelly Karstad, ( or x7138), can provide further information.

Academic Honesty

You are expected to be familiar with the college Academic Honesty Policy and to comply with that policy. Full descriptions of it and the Honor Code can be found in the Academic Catalog (online at http://www.gustavus.edu/general_catalog/current/acainfo). If you have any questions about it, please ask. A first violation of the honor code will result in a grade of 0 on the homework or exam in question. A further violation will result in an automatic F for the course and a notification to the Office of the Provost.

Help for Multilingual Students

Support for English learners and multilingual students is available through the Academic Support Center's Multilingual Learner Academic Specialist, Jody Bryant ( or x7197). The MLAS can meet individually with students for tutoring in writing, consulting about academic tasks, and helping students connect with the College's support systems. When requested, the MLAS can consult with faculty regarding effective classroom strategies for English learners and multilingual students. The MLAS can provide students with a letter to a professor that explains and supports appropriate academic arrangements (e.g., additional time on tests, additional revisions for papers). Professors make decisions based on those recommendations at their own discretion. In addition, English learners and multilingual students can seek help from peer tutors in the Writing Center (https://gustavus.edu/writingcenter/).

Please let me know if there is any accommodation in the course that would enable you to more fully show your abilities; for example, I would consider allowing extra time on tests, as well as allowing a dictionary in an otherwise closed-book test.

Title IX

Title IX is federal legislation that makes clear that violence and harassment based on sex or gender are civil rights violations. Gustavus Adolphus College takes incidents of sexual misconduct and sexual harassment seriously.

Sexual misconduct includes the following: non-consensual sexual contact, non-consensual sexual intercourse, sexual exploitation (taking non-consensual or abusive sexual advantage of another), intimate partner violence (physical, sexual, or psychological harm by a current or former partner or spouse), and stalking. (Please see the Student Sexual Misconduct Policy in the Gustavus Guide for more details and definitions or online at: http://www.gustavus.edu/deanofstudents/policies/gustieguide/sexualassault.php#misconduct).

Sexual Harassment is any behavior of a sexual nature that is unwelcome, offensive or fails to respect the rights and dignity of another person whether of the same or opposite sex. (Please see the All- College Policy against Harassment and Sexual Harassment for examples and more details: http://www.gustavus.edu/facultybook/allcollegepolicies/#Anchor-Sexua-60443.)

As a student who may choose to share information about an incident of sexual misconduct or sexual harassment with a Gustavus employee, you need to know that if Gustavus employees become aware of an incident of sexual harassment or sexual misconduct, they have to report information about these events to the appropriate college authorities. This requirement is to make sure the College can support and protect students.

So, if a faculty member becomes aware of an incident of sexual misconduct or sexual harassment, they must report what they know about this incident, including student names, to the Dean of Students Office within twenty-four hours.

The college will respect the confidentiality of the victim and alleged offender(s) as much as possible consistent with the College’s legal obligations. Students also always have a choice as to whether to participate in an investigation or not.

The only exception to this reporting responsibility for Gustavus employees is that conversations with SART/CADA, Chaplains, Counseling Center staff, and professional health care staff may be kept strictly confidential. SART/CADA can be reached 24 hours a day at 507-933-6868.

If you have any questions, contact the Title IX Coordinator (Paula O’Loughlin, Associate Provost, at 507-933-7541) or Deputy Coordinators (Stephen Bennett, Associate Dean of Students, at 507-933- 7526 or Ken Westphal, Vice President for Finance, at 507-933-7499).