TMA4275 Lifetime analysis, Spring 2018
Messages
June 1: I have posted a preliminary solution to todays exam below.
May 25: To get the grades on project 2, contact Rasmus. On May 30, I will be available for answering questions in R21 in realfagsbygget between 9:00 and 16:00 except between 10:30-11:30. Send me an email or sms (99705519) if I'm not there.
May 7: The syllabus of the course is mainly the slides, but also material covered as part of the exercises and the projects including material referred to in the project (some sections from Moore 2016). The exam will include output from survival analysis in R so you'll need to be familiar with such output and the models behind such output. Writing R code, however, will not be part of the exam.
May 1. Permitted aids on the exam are "Tabeller og formler i statistikk, Tapir Forlag, K. Rottmann: Matematisk formelsamling, Calculator Casio fx-82ES PLUS, CITIZEN SR-270X, CITIZEN SR-270X College or HP30S, one yellow A4-sheet with your own handwritten notes."
April 17. Tentative date for "spørretime" is Wednesday, May 30 from 10:00-15:00. Let me know if you prefer an other date.
April 12. Rasmus (and sometimes me) will be available at the computerlab on the next few Tuesdays at 9:00 to assist with project 2. The last lecture will be on Tuesday 17 (I will continue going through some old exam, problem 2, june 2017 next time).
April 10. I have moved the deadline for project 2 to May 6.
April 4. Fitting the NHPP process using optim in project 2 may be a bit tricky. You should obtain parameter estimates close to \(a=-3\), \(b=2\) and \(c=30\). Although the model is not strictly identifiable without imposing constraints on the parameter (note how several parameter values lead to the same model), the numerical optimisation appears to work best without imposing any constraints on \(a\), \(b\) and \(c\) and without doing any reparameterization. The optimization then appear to converge for almost any choice of starting values including c(0,0,0)
.
March 12. You can get your graded project 1 back if you visit Rasmus in his office, room 1126 in SII.
Feb. 9: In the coming weeks, for project 1 and 2, Rasmus (and some times me) will be available between 9 and 10 each tuesday in Nullrommet (instead of 8-9 in B3).
Feb. 6: No teaching in week 8 (on february 20 and 22).
Feb. 6: To find a better time to meet for assistance with project 1 and 2 (this will take place in Nullrommet), please fill in suitable times at this google docs sheet at your earliest convenience.
Feb. 5: Project 1 is out, see below.
Jan. 16: You'll need access to the computerlab later on in the semester. If you don't already have access, fill in the necessary information at https://goo.gl/forms/Vg8umJdGLm0ERn9f1 and I'll provide access.
Jan. 1: The first lecture is Tuesday, January 9 at 10:15 in F4.
General information
- Lecturer: Jarle Tufto, jarlet [at] math [dot] ntnu [dot] no, Room 1232, 12th floor, Sentralbygg II. Office Hours (treffetid): TBA.
- Teaching Assistant: Rasmus Erleman, rasmus [dot] erlemann [at] ntnu [dot] no, Sentralbygg II.
- Lectures: Tuesday 10:15-12:00 in F4 and Thursdays 12:15-14:00 in F3.
- Exercises: 8:15-9:00 in B3 (see https://www.ntnu.no/studier/emner/TMA4275#tab=timeplan) or * in the computer lab.
- Exam: June 1, 9:00.
Course material
Slides and lecture notes will be provided online along the course.
Relevant books for the course will be:
Meeker & Escobar: Statistical methods for reliability data. Wiley, 1998.
Collett: Modelling Survival Data in Medical Research. 2nd ed. Chapman & Hall/CRC 20003.
For background in basic statistics: Walpole, Myers, Myers and Ye: Probability and Statistics for Engineers and Scientists, Prentice Hall.
For background in stochastic processes: Sheldon M. Ross: Introduction to probability models, Academic Press.
Moore, 2016. Applied Survival Analysis using R (freely available as ebook on springer link) covers much of the same material as and also has detailed explanations on how to do things in R.
Weekly exercises
Note that the computer based exercises will be updated to include information on how to solve the problems in R.
# | Date & Place | Problems | Solution | |
---|---|---|---|---|
1 | 16.01 | Solution1 | ||
2 | 23.01 | Solution2 | ||
3 | 30.01 | pdf, | Solution3,SolutionwithRcode | |
4 | 06.02 | pdf + help with downloading MINITAB | Solution4,Rcodesolution | |
13.02 | Guidance Oblig 1 | |||
20.02 | Guidance Oblig 1 | |||
5 | 27.02 | Solution5 | ||
6 | 07.03 | Solution6 | ||
7 | 14.03 | Exam 2004: Problems 2 and 3 | Solution (see below) | |
21.03 | Guidance Oblig 2 | |||
28.03 | Guidance Oblig 2 | |||
8 | 04.04 | Solution8 | ||
9 | 25.04 | Exam 2005: Problem 2, Exam 2011: Problem 3 |
Obligatory exercises
There are two obligatory exercise sets that will be graded, each counting 10% of the final grade in the course. Two students may work together and submit a common report. If you have completed the obligatory exercises in an earlier year, you can optionally use the score from previous years (in this case, send me an email with your student id number).
* Obligatory I. Out: Friday 5 February. Deadline: Friday, 2 March. Submit your report at https://www.dropbox.com/request/ia2cPZxNqWUNubkqnxaE
* Obligatory II. Out: Wednesday, March 14. Deadline: Sunday, May 6. Submit your report at https://www.dropbox.com/request/V7ZD1OrfYMUwGvrWpLEt
These are tentative dates.
We recommend that you write the report using Markdown or LaTeX + knitr, perhaps using tools such as sharelatex, dropbox or git (via bitbucket.org) if you're collaborating. The report should be written as a self-contained document intelligible to your peers. Make sure you include the email and student identity number of all groups members.
Software and dataset
We recommend R and Rstudio and the survival-package all of which can be downloaded and installed for free. If you're not familiar with R you may want to read and solve some of the problems in "A (very) short introduction to R". A more detailed and technical introduction focusing on R as a language is "An Introduction to R". You may alternatively use https://innsida.ntnu.no/wiki/-/wiki/English/Minitab but then you're mostly on your own.
Lecture plan and progress
R&H refers to relevant sections in Rausand & Høyland: System Reliability Theory: Models, Statistical Methods, and Applications, 2nd Edition. Wiley 2004.
Date | R&H | Topic | Slides | Notes/Supplementary reading |
---|---|---|---|---|
09.01 | 2.3-2.5 | Introduction and motivation. General concepts for lifetime modeling. | Slides 1, Slides 2 | |
11.01 | 2.6, 2.9-2.14 | Parametric families of lifetime distributions. | Slides 3 | |
16.01 | (2.17) | Gumbel distribution. Log-location-scale families | Slides 4 | Extreme value distribution, More on log-location-scale families |
18.01 | 11.1-11.3.3, 11.3.5 | Censoring; empirical survival function; Kaplan-Meier estimator. Nelson-Aalen estimator | Slides 5,Slides 6, p. 1-6 | Alternative derivation of K.-M.-estimator as non-parametric maximum likelihood estimate of R(t). I'll go through this in the lecture. |
23.01 | 11.3.6 | Properties of the exponential distribution | Slides 6, p. 7-16 | About the Exponential Distribution, Poisson Process, Total Time on Test and Barlow-Proschan's Test. |
25.01 | 11.3.7 | Derivation of Kaplan-Meier and Nelson-Aalen estimator, TTT-plot | Slides 5 and Slides 6 (p. 17-23) | |
30.01 | The logrank test. | | |
|
01.02 | 11.3.7 | More on TTT-plot. Barlow-Proschans test. Introduction to parametric methods | Slides 6 (p. 24-43) | Algorithm for TTT and BP |
06.02 | 11.4.3, 11.4.4, 11.4.5 | Parametric inference for the exponential model. Confidence intervals for the exponential distribution. | Slides 8, p. 1-21. | The standard confidence interval for positive parameters. Some likelihood theory. |
08.02 | Likelihood contributions from left truncated, left censored and interval censored observations. | Slides 7 | Ch. 3.5 and ch. 12.2 in Moore. aftreg in eha R-package does survival regression with left truncation (survreg in the survival-package does not). icfit in the interval package does non-parametric estimation of \(R(t)\) for left and interval censored data (survfit in the survival package does not) | |
13.02 | 11.4.5 | Parametric inference for the Weibull model | Slides 9, p. 1-15 | |
15.02 | 11.4.5 | Parametric inference for the Weibull model (cont). Inference in log-location-scale models. | Slides 9, p. 15-17, Slides 10, p. 1-20 | |
27.02 | Threshold models (3-parameter Weibull). Parametric survival regression. | Slides 10, p. 21-27 (p. 28-31 not in curriculum), Slides 11, p. 1-22 | Book chapter on survival regression | |
01.03 | Parametric survival regression (cont.), Proportional hazards and Cox-regression | Slides 11, p. 23-43, | Modelling of covariates and factors | |
06.03 | Proportional hazards and Cox-regression (cont.) | Slides 12, p. 1-16 | Case study in Cox regression: Medical data | |
08.03 | Proportional hazards and Cox-regression (cont.) | Slides 12, p. 17-31 | Case study in Cox regression: Reliability, Some notes on ties etc.. | |
13.03 | 7.1, 7.2.1 | Model checking in Cox-regression. Case study of Cox-regression. | Slides 12, p. 32-48, Moore 2016, ch. 7 | |
12, 7.3.1, 7.4.1, 7.4.2, 7.4.3 | Accelerated life testing. Recurrent events and repairable systems. | Slides 13, Slides 14, p. 1-14 | Download INSULATE.MTW | |
7.3.1, 7.4.1, 7.4.2, 7.4.3 | Recurrent events and repairable systems. The nonhomogeneous Poisson process (NHPP). | Slides 14, p. 15-23 | ||
7.4.3 | Nonparametric estimation in repairable systems. | Slides 14, p. 24-35 | ||
7.4.3, 7.4.4 | Final example on nonparametric estimation in repairable systems, Parametric estimation in NHPPs. | Slides 14, p. 36-41, Slides 15, p. 1-10 | Alternative derivation of likelihood function | |
15.3 | 7.4.4, 7.4.5, 7.3.1, 7.3.2, 7.3.3 | Parametric estimation in NHPPs. Trend testing in NHPPs. Renewal processes. | Slides 15, p. 11-23, Slides 16, p. 1-28 (p. 29-31 are not in curriculum) | |
Easter | ||||
10.4, 12.4, 17.4, 19.4 | Go through and discuss topics from exam exercises (in this order, as far as we get): 2009 Problems 2,3 (10.04) 2012 Problems 1 (10.04), 2 (12.04) 2014 Problem 2 (12.04) 2010 Problem 2,3 (17.04) 2014 Problem 3 2014 Problem 1 | Chi-square critical values |
Earlier exams
Exam | English | Norwegian | Solution |
---|---|---|---|
2018V | |||
2017V | |||
2016V | |||
2015V | |||
2014V | |||
2013V | |||
2012V | Probl 1-2-4 | ||
2011V | |||
2010V | Probl 2-3 | ||
2009V | |||
2008V | |||
2007V | |||
2006V | |||
2005V | |||
2004V | |||
2003V | |||
2002V | |||
2001V | |||
2000V |
Typos in R&H, 2004, 2nd ed.
Page. 56: First line should read "as \(t \rightarrow -\infty\)" (instead of "\(+\infty\)").