Statistics for EngineersInteractive study companion · 16 chapters. Dr. Kay Rand Morgan.
STATISTICS FOR ENGINEERSCOVERSHEET 01 / 19REV A
A worked-example approach
Statistics for Engineers
A complete introductory statistics course for first- and second-year engineering and engineering technology students — aligned with SUNY community college statistics sequences. Sixteen chapters, each with plain-language explanations, five fully worked examples, and five practice problems you can check instantly.
1. Read
Each chapter explains the idea in plain language, with every formula shown as a numbered callout.
2. Imitate
Work each example with pencil and calculator, then open the step-by-step solution and check yourself.
3. Practice
Attempt the five practice problems, reveal each answer when ready, and mark the chapter complete.
Engineers measure things: the diameter of a shaft, the breaking strength of a weld, the number of defective circuit boards in a shipment. Statistics is the science of collecting, organizing, analyzing, and interpreting those measurements so that good decisions can be made in the presence of variation. No two machined parts are ever exactly identical, and no two test results ever agree perfectly — statistics gives you the tools to describe that variation and to draw reliable conclusions from it.
1.1 Population, Sample, Parameter, Statistic
A population is the entire collection of individuals or items under study — every bearing produced this month, every concrete cylinder poured on a project. A sample is a subset of the population that is actually observed or measured. We use samples because measuring an entire population is usually too expensive, too slow, or physically impossible (destructive testing destroys the part!).
A number that describes a population is a parameter (for example, the true mean diameter μ of all bearings). A number computed from a sample is a statistic (for example, the sample mean x̄ of 50 inspected bearings). Greek letters (μ, σ, p) are traditionally used for parameters; Roman letters (x̄, s, p̂) for statistics.
1.2 Types of Data
Qualitative (categorical) data place items into categories: material type, pass/fail, vendor name. Quantitative data are numerical measurements or counts. Quantitative data are further split into:
Discrete data — countable values, usually whole numbers: number of defects on a panel, number of trucks arriving per hour.
Continuous data — any value in an interval, limited only by the precision of the instrument: length, mass, temperature, voltage, time.
1.3 Levels of Measurement
Data can also be classified by how much mathematical meaning the numbers carry:
Nominal — names or labels only, no order (steel / aluminum / titanium).
Ordinal — ordered categories, but differences are not meaningful (surface finish rated poor / fair / good / excellent).
Interval — ordered with meaningful differences but no true zero; ratios are meaningless (temperature in °C or °F).
Ratio — meaningful differences and a true zero, so ratios make sense (length, mass, force, time, temperature in kelvin).
1.4 Collecting Data: Sampling Methods
The value of any statistical conclusion depends on how the data were collected. Common sampling designs:
Simple random sample — every group of n items in the population has the same chance of being chosen (e.g., select 50 serial numbers with a random number generator).
Systematic sample — select every kth item after a random start (every 20th part off the line).
Stratified sample — divide the population into subgroups (strata) such as machines or shifts, then randomly sample from each.
Cluster sample — randomly select whole groups (entire pallets, entire crates) and inspect everything in the chosen groups.
Convenience sample — take whatever is easiest. Fast, but prone to bias; avoid it for serious work.
In an observational study, the engineer records data without controlling conditions. In a designed experiment, the engineer deliberately changes one or more factors (the treatments) and observes the effect on a response variable. Only well-designed experiments can establish cause and effect.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 1.1Example 1.1: Population vs. sample
A quality engineer selects 50 bearings from a production run of 5,000 and finds that 2% of the 50 are outside the diameter tolerance. Identify the population, the sample, the statistic, and the parameter of interest.
Solution
Population: all 5,000 bearings in the production run.
Sample: the 50 bearings actually inspected.
Statistic: the 2% defect rate computed from the sample (p̂ = 0.02).
Parameter of interest: the true (unknown) proportion p of defective bearings among all 5,000. The engineer will use the statistic to estimate the parameter.
EX 1.2Example 1.2: Classifying variables
Classify each variable as qualitative or quantitative; if quantitative, state whether it is discrete or continuous: (a) number of solder defects on a circuit board, (b) curing time of an epoxy sample, (c) type of alloy used, (d) mass of a casting, (e) number of trucks arriving at a loading dock per hour.
Solution
(a) Quantitative, discrete — a count of defects (0, 1, 2, …).
(b) Quantitative, continuous — time can take any value in an interval.
(c) Qualitative — alloy type is a category, not a number.
(d) Quantitative, continuous — mass is a measurement.
(e) Quantitative, discrete — a count of arrivals.
EX 1.3Example 1.3: Levels of measurement
State the level of measurement for each: (a) part identification numbers, (b) hardness rank of five samples (1 = softest to 5 = hardest), (c) temperature of a furnace in °C, (d) tensile strength in MPa, (e) weld quality rated “reject / acceptable / excellent.”
Solution
(a) Nominal — the ID numbers are labels; arithmetic on them is meaningless.
(b) Ordinal — the ranks are ordered, but the difference between rank 1 and 2 need not equal the difference between 4 and 5.
(c) Interval — differences in °C are meaningful, but 0 °C is not a true zero, so 40 °C is not “twice as hot” as 20 °C.
(d) Ratio — strength has a true zero; 400 MPa is genuinely twice 200 MPa.
(e) Ordinal — ordered categories without measurable spacing.
EX 1.4Example 1.4: Identifying the sampling method
Name the sampling method used in each case: (a) an inspector tests every 25th part coming off a conveyor; (b) 10 parts are randomly selected from each of the three shifts; (c) four crates are chosen at random from a warehouse and every item in those crates is inspected; (d) 60 serial numbers are drawn using a random number generator.
Solution
(a) Systematic sampling — every kth item with k = 25.
(b) Stratified sampling — the shifts are strata, and a random sample is taken from each.
(c) Cluster sampling — whole crates (clusters) are selected, then fully inspected.
(d) Simple random sampling — every set of 60 parts is equally likely.
EX 1.5Example 1.5: Observational study vs. experiment
A team wants to know whether a new cutting fluid reduces tool wear. Plan A: review last year’s maintenance logs for machines that happened to use different fluids. Plan B: randomly assign 20 identical machines, 10 to the new fluid and 10 to the old, run identical jobs, and measure wear. Classify each plan and identify the treatment and response in the experiment.
Solution
Plan A is an observational study — the engineers only record what already happened, with no control over which machine used which fluid. Other differences between machines could bias the comparison.
Plan B is a designed experiment — the factor (cutting fluid) is deliberately assigned at random.
Treatment: the type of cutting fluid (new vs. old). Response variable: measured tool wear.
Because machines are randomly assigned in Plan B, a difference in wear can be attributed to the fluid — cause and effect.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
1.1 A civil engineer tests 12 concrete cylinders out of the 300 poured on a bridge project and finds a mean strength of 31.2 MPa for the 12 cylinders. Identify the population, the sample, the statistic, and the parameter of interest.
Answer. Population: all 300 cylinders. Sample: the 12 tested. Statistic: x̄ = 31.2 MPa. Parameter: the true mean strength μ of all 300 cylinders.
1.2 Classify each variable as qualitative or quantitative, and discrete or continuous where appropriate: (a) voltage output of a power supply, (b) number of warranty claims per month, (c) supplier name, (d) operating temperature of a motor, (e) number of rivets in a wing panel.
1.3 Give the level of measurement: (a) ZIP codes of customers, (b) Mohs hardness ranking of minerals, (c) boiling point in °F, (d) current in amperes, (e) customer satisfaction rated 1–5 (very poor to very good).
1.4 Identify the sampling method: (a) 15 parts randomly chosen from each of four CNC machines; (b) every 50th unit is pulled for inspection; (c) the technician grabs the 30 parts nearest the door; (d) three full pallets are randomly selected and every box on them is opened.
1.5 To test whether preheating reduces weld cracking, 40 identical joints are randomly split into two groups of 20; one group is preheated before welding and the other is not, and cracks are counted. Is this observational or experimental? Name the treatment and the response variable.
Answer. Designed experiment (the factor is randomly assigned). Treatment: preheating vs. no preheating. Response: number of weld cracks.
STATISTICS FOR ENGINEERSCH 02SHEET 03 / 19REV A
Chapter 2
Organizing and Visualizing Data
Raw data are just a pile of numbers. The first job of the engineer is to organize them so that patterns become visible: Where is the center? How spread out are the values? Is the distribution symmetric or skewed? Are there gaps or outliers? Frequency tables, histograms, and stem-and-leaf displays answer these questions at a glance.
2.1 Frequency Distributions
A frequency distribution groups data into non-overlapping classes and counts how many observations fall in each. To build one with k classes (usually 5 to 10):
Step 1. Compute the class width: (maximum − minimum) ÷ k, then round UP to a convenient number.
Step 2. Choose the lower limit of the first class at or just below the minimum; add the width repeatedly to form the classes.
Step 3. Tally the observations into the classes; the counts are the frequencies f.
The relative frequency of a class is f/n, the fraction of all data in that class. The cumulative frequency is the running total of frequencies up through that class. The class midpoint is the average of the class limits and represents the class in later calculations.
2.2 Histograms and Distribution Shape
A histogram displays classes on the horizontal axis and frequencies as touching bars. Watch for these common shapes:
Symmetric (bell-shaped) — measurement error, many natural processes.
Skewed right — long tail toward high values (repair times, lifetimes).
Skewed left — long tail toward low values.
Uniform — all classes roughly equal.
Bimodal — two peaks, often a signal that two different processes or machines are mixed in one data set.
2.3 Stem-and-Leaf Displays
A stem-and-leaf display keeps every data value visible while still showing shape. Each value is split into a stem (leading digit or digits) and a leaf (final digit). Leaves are listed in increasing order beside their stem. It is a quick, pencil-friendly alternative to a histogram for small data sets.
2.4 Other Useful Graphs
Pareto chart — a bar chart of defect categories sorted from most to least frequent; identifies the “vital few” causes.
Time-series plot — data plotted in production order; reveals trends and shifts that a histogram hides.
Scatter plot — pairs (x, y) plotted to reveal relationships between two variables (Chapter 13).
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 2.1Example 2.1: Building a frequency distribution
Battery run times (hours) for 20 test units: 12, 15, 17, 18, 19, 20, 22, 23, 24, 25, 26, 27, 28, 29, 31, 33, 34, 36, 38, 39. Construct a frequency distribution with 5 classes.
Rockwell hardness readings for 12 samples: 56, 58, 61, 63, 63, 67, 70, 72, 75, 75, 78, 84. Construct a stem-and-leaf display and comment on the shape.
Solution
Use the tens digit as the stem and the units digit as the leaf.
5 | 6 8
6 | 1 3 3 7
7 | 0 2 5 5 8
8 | 4
The display is roughly symmetric with a single peak in the 70s and no gaps or outliers.
EX 2.4Example 2.4: Reading distribution shape
Repair times were grouped into classes with frequencies 14, 9, 5, 3, 2, 1 (from the shortest-time class to the longest). Describe the shape and explain why this shape is typical for repair-time data.
Solution
The frequencies fall steadily: the tallest bar is at the left (short times) and a long, thin tail stretches to the right.
The distribution is skewed right (positively skewed).
This is typical because most repairs are quick, but occasionally a difficult failure takes far longer — extreme values occur only on the high side.
EX 2.5Example 2.5: Using cumulative frequency
Using the cumulative frequencies from Example 2.2, how many batteries ran less than 30 hours, and what percentage of the sample is that?
Solution
“Less than 30 hours” means the classes 12–17, 18–23, and 24–29.
Cumulative frequency through 24–29 is 14.
Percentage: 14/20 = 0.70 = 70%. So 14 batteries (70% of the sample) ran less than 30 hours.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
2.1 Machine downtime (minutes) for 20 incidents: 5, 7, 8, 10, 12, 13, 15, 16, 18, 20, 21, 23, 25, 26, 28, 30, 32, 35, 37, 40. Construct a frequency distribution with 5 classes (round the class width up to 8) and list the frequencies.
2.3 Construct a stem-and-leaf display for these 12 tensile strengths (ksi): 41, 43, 47, 52, 55, 55, 58, 60, 64, 69, 71, 73.
Answer. Stems 4–7: 4 | 1 3 7; 5 | 2 5 5 8; 6 | 0 4 9; 7 | 1 3. Roughly symmetric, single peak in the 50s.
2.4 Surface roughness classes have frequencies 2, 5, 12, 5, 2 from lowest class to highest. Describe the shape of the distribution.
Answer. Symmetric and bell-shaped (single central peak, mirror-image tails).
2.5 Using your answer to Problem 2.1, how many downtime incidents lasted 28 minutes or less, and what percentage of the sample is that?
Answer. Cumulative frequency through the 21–28 class is 15, i.e., 15/20 = 75% of incidents.
STATISTICS FOR ENGINEERSCH 03SHEET 04 / 19REV A
Chapter 3
Measures of Central Tendency
After organizing data, the next question is: where is the center? A single well-chosen number — an average — often summarizes hundreds of measurements. This chapter covers the three classic measures of center (mean, median, mode), plus the weighted mean and the mean of grouped data, and explains when each is the right tool.
3.1 The Mean
The arithmetic mean is the sum of the values divided by how many there are:
EQ 3.1x̄ = Σx / n (sample) μ = Σx / N (population)
The mean uses every data value, which makes it the most common measure — but also makes it sensitive to outliers: one wild value can drag the mean far from the bulk of the data.
3.2 The Median and the Mode
The median is the middle value when the data are sorted. If n is odd, it is the single middle value; if n is even, it is the average of the two middle values. The median is resistant to outliers, which makes it the preferred center for skewed data such as incomes, lifetimes, and repair costs.
The mode is the most frequently occurring value. A data set may have one mode, several modes, or none. The mode is the only measure of center that works for qualitative data (the most common failure type, the most used material).
3.3 The Weighted Mean
When values carry different importance, weight each value wᵢ and compute:
EQ 3.2x̄w = Σ(w·x) / Σw
Course grades, composite material properties, and blended costs are all weighted means.
3.4 Mean of a Frequency Distribution
When only grouped data are available, use each class midpoint m as the representative value of its class:
EQ 3.3x̄ ≈ Σ(f·m) / n
This is an approximation — exact values inside each class are unknown — but it is usually very close.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 3.1Example 3.1: Mean, median, mode
Cycle times (seconds) for eight robot welds: 12, 15, 11, 14, 15, 13, 12, 15. Find the mean, median, and mode.
Solution
Mean: Σx = 12+15+11+14+15+13+12+15 = 107, so x̄ = 107/8 = 13.375 s.
Sort the data: 11, 12, 12, 13, 14, 15, 15, 15. With n = 8 (even), the median is the average of the 4th and 5th values: (13 + 14)/2 = 13.5 s.
Mode: 15 s appears three times, more than any other value.
EX 3.2Example 3.2: Outliers and the median
Five service calls took 23, 25, 26, 27, and 120 minutes. Compute the mean and median, and state which better represents a “typical” call.
Solution
Mean: (23+25+26+27+120)/5 = 221/5 = 44.2 minutes.
Median: sorted data 23, 25, 26, 27, 120 → middle value = 26 minutes.
The single 120-minute outlier pulls the mean up to 44.2, a value larger than four of the five calls. The median (26 min) better represents a typical call. Report the median for skewed data.
EX 3.3Example 3.3: Weighted mean
A statistics course computes the final grade as 40% exams, 35% labs, 25% homework. A student earned 90 on exams, 80 on labs, and 70 on homework. Find the final grade.
Solution
Apply x̄w = Σ(w·x)/Σw with weights 0.40, 0.35, 0.25 (they already sum to 1).
The mean of five viscosity readings is 20.0. Four of the readings are 18, 22, 25, and 15. Find the fifth reading.
Solution
If the mean of five values is 20.0, the total must be 5 × 20.0 = 100.
The four known readings sum to 18+22+25+15 = 80.
Fifth reading = 100 − 80 = 20.0.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
3.1 Seven flow-rate readings (L/min): 8, 10, 9, 12, 10, 11, 10. Find the mean, median, and mode.
Answer. Mean = 70/7 = 10 L/min; median = 10; mode = 10.
3.2 Five repair invoices: $45, $47, $48, $50, $190. Compute the mean and the median, and state which is the better “typical” value and why.
Answer. Mean = $76; median = $48. The median — the $190 outlier inflates the mean above four of the five invoices.
3.3 A composite score weights a design project 50%, a midterm 30%, and quizzes 20%. A student scores 85, 90, and 60 respectively. Find the weighted mean.
3.5 The mean of six pressure readings is 15.0 psi. Five of them are 12, 14, 16, 18, and 10. Find the sixth reading.
Answer. Total needed = 6(15) = 90; known sum = 70; sixth reading = 20 psi.
STATISTICS FOR ENGINEERSCH 04SHEET 05 / 19REV A
Chapter 4
Measures of Variability and Position
Two processes can have the same average and behave completely differently: one holds tolerance, the other scatters parts everywhere. Variability is often the engineer’s real enemy, and this chapter gives you the tools to measure it — range, variance, standard deviation, coefficient of variation — plus measures of position: z-scores, percentiles, quartiles, and the outlier fences used in boxplots.
4.1 Range, Variance, and Standard Deviation
The range = maximum − minimum is quick but uses only two values. The workhorse measures are the variance and standard deviation, built from the deviations (x − x̄) of every value from the mean:
EQ 4.1s² = Σ(x − x̄)² / (n − 1) s = √s² (sample)
EQ 4.2σ² = Σ(x − μ)² / N σ = √σ² (population)
The sample formula divides by n − 1 (the degrees of freedom), which corrects the tendency of small samples to underestimate spread. The standard deviation has the same units as the data, which is why it is quoted far more often than the variance.
A computational shortcut avoids computing each deviation:
EQ 4.3s² = [ Σx² − (Σx)²/n ] / (n − 1)
4.2 Coefficient of Variation
To compare the spread of variables with different units or very different means, use the coefficient of variation — the standard deviation as a percentage of the mean:
EQ 4.4CV = (s / x̄) × 100%
4.3 The Empirical Rule and Chebyshev’s Theorem
For bell-shaped distributions, the Empirical Rule says approximately:
68% of the data lie within 1 standard deviation of the mean (μ ± σ),
95% within 2 standard deviations (μ ± 2σ),
99.7% within 3 standard deviations (μ ± 3σ).
For ANY distribution, bell-shaped or not, Chebyshev’s theorem guarantees that at least 1 − 1/k² of the data lie within k standard deviations of the mean (k > 1): at least 75% within 2σ, at least 88.9% within 3σ.
4.4 Measures of Position: z-Scores, Percentiles, Quartiles
The z-score converts a value into “standard deviations from the mean”:
EQ 4.5z = (x − x̄) / s or z = (x − μ) / σ
A z-score near 0 is typical; values beyond ±2 are unusual; beyond ±3, rare. Z-scores also let you compare apples to oranges — a measurement’s relative standing in its own distribution.
The pth percentile is the value below which about p% of the data fall. The quartiles Q1, Q2 (the median), and Q3 split the data into four quarters, and the interquartile range IQR = Q3 − Q1 measures the spread of the middle 50%.
Outlier fences: values below Q1 − 1.5·IQR or above Q3 + 1.5·IQR are flagged as outliers. The five-number summary (min, Q1, median, Q3, max) is drawn as a boxplot: a box from Q1 to Q3 with a line at the median and whiskers to the most extreme non-outlier values.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 4.1Example 4.1: Standard deviation by definition
Hardness deviations for five samples: 4, 8, 6, 5, 7. Find the range, sample variance, and sample standard deviation.
Deviations: −2, 2, 0, −1, 1. Squared: 4, 4, 0, 1, 1. Sum of squares = 10.
s² = 10/(5 − 1) = 2.5.
s = √2.5 = 1.5811.
EX 4.2Example 4.2: Computational shortcut
Verify the variance in Example 4.1 using the computational formula.
Solution
Σx = 30 and Σx² = 16 + 64 + 36 + 25 + 49 = 190.
(Σx)²/n = 30²/5 = 180.
s² = (190 − 180)/(5 − 1) = 10/4 = 2.5 ✓ — the same value with no deviations needed.
EX 4.3Example 4.3: Coefficient of variation
Shaft diameters average 50 mm with s = 0.5 mm. Torque readings on another line average 200 N·m with s = 4 N·m. Which process is relatively more consistent?
Solution
CV(shafts) = (0.5/50) × 100% = 1.0%.
CV(torque) = (4/200) × 100% = 2.0%.
The shaft process is relatively more consistent — its spread is only 1% of its mean, versus 2% for torque. Raw standard deviations could not be compared directly because the units differ.
EX 4.4Example 4.4: Empirical rule and z-scores
Breaking strengths are bell-shaped with μ = 100 kN and σ = 5 kN. (a) Between what two values do about 95% of parts fall? (b) About what percent exceed 105 kN? (c) Find the z-score of a 108 kN part.
Solution
(a) 95% lie within 2σ: 100 ± 2(5) = 90 to 110 kN.
(b) 105 kN is exactly μ + 1σ. Since 68% lie within ±1σ, 32% lie outside, split equally: about 16% exceed 105 kN.
(c) z = (108 − 100)/5 = 1.6 — the part is 1.6 standard deviations above the mean, strong but not unusual.
EX 4.5Example 4.5: Quartiles, IQR, and outliers
Nine cure times (min): 7, 9, 12, 14, 15, 18, 20, 22, 25. Find the quartiles, the IQR, and the outlier fences, and state whether any value is an outlier.
Solution
The data are already sorted; n = 9, so the median is the 5th value: Q2 = 15.
4.3 Process A: mean 120 units/hr, s = 6. Process B: mean 80 units/hr, s = 5. Use the coefficient of variation to decide which process is relatively more consistent.
Answer. CV(A) = 5.0%, CV(B) = 6.25%; Process A is relatively more consistent.
4.4 Resistor values are bell-shaped with μ = 60 Ω and σ = 4 Ω. (a) Between what two values do about 68% of resistors fall? (b) Find the z-score of a 70 Ω resistor. (c) About what percent exceed 68 Ω?
Answer. (a) 56 to 64 Ω; (b) z = 2.5; (c) 68 Ω is μ + 2σ, so about 2.5% exceed it.
4.5 Nine response times (ms): 3, 6, 7, 8, 10, 12, 13, 15, 40. Find Q1, the median, Q3, the IQR, the outlier fences, and identify any outliers.
Answer. Median = 10; Q1 = 6.5; Q3 = 14; IQR = 7.5; fences −4.75 and 25.25; the value 40 is an outlier.
STATISTICS FOR ENGINEERSCH 05SHEET 06 / 19REV A
Chapter 5
Probability Fundamentals
Probability is the language of uncertainty. Will this relay fail? Is the defect from machine A or machine B? Probability assigns a number between 0 (impossible) and 1 (certain) to events, and gives us rules for combining those numbers. Everything in inferential statistics — confidence intervals, hypothesis tests, control charts — is built on the rules in this chapter.
5.1 Experiments, Sample Spaces, and Events
A probability experiment is any process with an uncertain outcome (test one part, roll a die, measure a voltage). The sample space S is the set of all possible outcomes, and an event is any subset of the sample space. Three ways to assign probability:
Classical: if all outcomes are equally likely, P(E) = (number of outcomes in E) / (number in S).
Empirical (relative frequency): P(E) ≈ (times E occurred) / (number of trials).
Subjective: an expert judgment when neither of the above applies.
The complement of E, written E′, is “E does not happen,” and:
EQ 5.1P(E′) = 1 − P(E)
5.2 The Addition Rule
For any two events A and B:
EQ 5.2P(A or B) = P(A) + P(B) − P(A and B)
The subtraction removes the double-counted overlap. If A and B are mutually exclusive (cannot happen together), P(A and B) = 0 and the rule reduces to P(A or B) = P(A) + P(B).
5.3 Conditional Probability and Independence
The conditional probability of A given that B has occurred is:
EQ 5.3P(A | B) = P(A and B) / P(B)
Events A and B are independent if knowing one tells you nothing about the other: P(A | B) = P(A). For independent events the multiplication rule simplifies:
EQ 5.4P(A and B) = P(A) · P(B) (independent events)
For dependent events, use the general multiplication rule P(A and B) = P(A) · P(B | A). Independence is the key assumption behind series-system reliability calculations: a chain of independent components works only if every component works.
5.4 Total Probability and Bayes’ Theorem
When an outcome can arise from several sources (machines, vendors, production lines), the law of total probability adds the weighted contributions, and Bayes’ theorem “reverses” the conditioning to find where an observed outcome most likely came from:
EQ 5.5P(A | D) = P(A)·P(D | A) / [ P(A)·P(D | A) + P(B)·P(D | B) + … ]
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 5.1Example 5.1: Classical probability and complement
A batch contains 40 parts, of which 6 are defective. One part is selected at random. Find the probability it is defective, and the probability it is good.
On a circuit board, P(solder defect) = 0.30, P(component defect) = 0.20, and P(both) = 0.08. Find the probability a board has at least one of the two defect types.
Solution
P(solder or component) = P(solder) + P(component) − P(both)
= 0.30 + 0.20 − 0.08 = 0.42.
There is a 42% chance of at least one defect type. (Adding 0.30 + 0.20 alone would double-count the 8% of boards with both.)
EX 5.3Example 5.3: Conditional probability from a table
Inspection records: the day shift produced 300 parts with 6 defective; the night shift produced 200 parts with 9 defective. A part is chosen at random from the 500. Find P(defective), P(defective | night shift), and state whether “defective” and “night shift” are independent.
Solution
Total defectives = 6 + 9 = 15, so P(defective) = 15/500 = 0.03.
P(defective | night) = 9/200 = 0.045.
Since P(defective | night) = 0.045 ≠ 0.03 = P(defective), the events are NOT independent — defect rate depends on the shift, a lead worth investigating.
EX 5.4Example 5.4: Independence and reliability
A control circuit uses two independent relays, each of which works with probability 0.98. (a) Find the probability both relays work. (b) The circuit is wired so it functions if at least one relay works; find that probability.
(b) The circuit fails only if BOTH fail: P(both fail) = 0.02 × 0.02 = 0.0004.
P(at least one works) = 1 − 0.0004 = 0.9996.
Redundancy (a parallel design) raises reliability from 98% per relay to 99.96% for the pair.
EX 5.5Example 5.5: Bayes’ theorem
Machine A produces 60% of a plant’s output with a 2% defect rate; machine B produces 40% with a 5% defect rate. A randomly selected part is defective. What is the probability it came from machine A?
Total defect rate: P(D) = 0.012 + 0.020 = 0.032 (3.2% of all parts).
P(A | D) = 0.012 / 0.032 = 0.375.
Even though A makes most of the parts, only 37.5% of defectives come from A — machine B is the bigger problem.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
5.1 A tray holds 50 machined parts, 4 of which are out of tolerance. One part is picked at random. Find the probability it is out of tolerance, and the probability it is in tolerance.
5.2 For castings, P(porosity) = 0.25, P(crack) = 0.15, and P(both) = 0.05. Find the probability that a casting has porosity or a crack (or both).
Answer. P = 0.25 + 0.15 − 0.05 = 0.35.
5.3 Vendor X supplied 200 sensors with 8 defective; vendor Y supplied 100 sensors with 12 defective. One sensor is chosen at random from the 300. Find P(defective) and P(defective | vendor Y). Are “defective” and “vendor Y” independent?
Answer. P(defective) = 20/300 = 0.0667; P(defective | Y) = 12/100 = 0.12. Not independent (0.12 ≠ 0.0667) — vendor Y’s rate is far worse.
5.4 Three independent smoke detectors each work with probability 0.95. Find the probability that (a) all three work, and (b) at least one works.
5.5 Line 1 makes 70% of production with a 3% defect rate; line 2 makes 30% with an 8% defect rate. A defective unit is found. What is the probability it came from line 2?
Classical probability requires counting outcomes, and in real problems the counts are far too large to list. Three tools — the fundamental counting principle, permutations, and combinations — let you count millions of possibilities in one line. They also feed directly into the binomial distribution of Chapter 7 and acceptance-sampling calculations used throughout industry.
6.1 The Fundamental Counting Principle
If a task consists of a sequence of steps, and step 1 can be done in n₁ ways, step 2 in n₂ ways, and so on, the whole task can be done in n₁ · n₂ · n₃ ··· ways. This one idea handles part numbers, passwords, menu configurations, and test plans.
6.2 Factorials and Permutations
n! (“n factorial”) = n(n−1)(n−2)···(2)(1), with 0! = 1. A permutation is an ordered arrangement. The number of ways to arrange r items chosen from n distinct items, where order matters, is:
EQ 6.1nPr = n! / (n − r)!
Use permutations when the positions are different: first/second/third place, which part goes to which test rig, orderings of a startup sequence.
6.3 Combinations
A combination is a selection where order does NOT matter — a handful, a committee, a sample pulled for inspection:
EQ 6.2nCr = n! / [ r!(n − r)! ]
6.4 Counting in Probability: Sampling Without Replacement
Combinations turn “what is the chance my random sample contains k defectives?” into a ratio of counts:
Five prototype pumps are available, and three must be assigned to test stands 1, 2, and 3 (a different pump to each stand). How many assignments are possible?
Solution
The stands are distinct, so order matters — this is a permutation of 3 items from 5.
5P3 = 5!/(5−3)! = 120/2 = 60.
There are 60 possible assignments.
EX 6.3Example 6.3: Combinations
Ten turbine blades are produced and three will be selected for destructive testing. How many different samples of three blades are possible?
Solution
The three blades form a group — order does not matter — so use combinations.
A box of 12 fittings contains 3 defective ones. Two fittings are drawn at random without replacement. Find the probability that both are good.
Solution
Good fittings: 9. Ways to choose 2 good ones: 9C2 = 36.
Ways to choose any 2 from 12: 12C2 = 66.
P(both good) = 36/66 = 6/11 = 0.5455.
EX 6.5Example 6.5: Combining combinations
A design review team must include exactly 3 engineers chosen from 6, and exactly 2 technicians chosen from 4. How many different teams are possible?
Solution
Choose the engineers: 6C3 = 20 ways.
Choose the technicians: 4C2 = 6 ways.
By the counting principle, total teams = 20 × 6 = 120.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
6.1 A serial number has two letters followed by three digits (repeats allowed everywhere). How many serial numbers are possible?
Answer. 26 × 26 × 10 × 10 × 10 = 676,000.
6.2 Eight instruments are available and two must be assigned, one to the inlet station and one to the outlet station. How many assignments are possible?
Answer. 8P2 = 8 × 7 = 56.
6.3 From a lot of 12 gearboxes, 4 will be selected for endurance testing. How many different samples are possible?
Answer. 12C4 = 495.
6.4 A shipment of 15 valves contains 4 defective ones. Three valves are drawn at random without replacement. Find the probability that none of the three is defective.
Answer. 11C3 / 15C3 = 165/455 = 0.3626.
6.5 A project team needs exactly 2 electrical engineers from a pool of 5 and exactly 3 mechanical engineers from a pool of 7. How many teams are possible?
Answer. 5C2 × 7C3 = 10 × 35 = 350.
STATISTICS FOR ENGINEERSCH 07SHEET 08 / 19REV A
Chapter 7
Discrete Random Variables: Binomial and Poisson Distributions
A random variable attaches a number to each outcome of an experiment — the number of defects on a board, the number of failures in a fleet. This chapter shows how to describe a discrete random variable with a probability distribution, how to compute its mean and standard deviation, and how to use the two most important discrete models in engineering: the binomial and the Poisson.
7.1 Probability Distributions of Discrete Random Variables
A discrete probability distribution lists every possible value x and its probability P(x). Two requirements: every P(x) is between 0 and 1, and ΣP(x) = 1. Probabilities of events are found by adding the P(x) values involved.
7.2 Mean and Variance of a Random Variable
The mean (expected value) and variance of a discrete random variable are weighted by probability:
EQ 7.1μ = Σ[x·P(x)] σ² = Σ[x²·P(x)] − μ² σ = √σ²
The expected value is the long-run average per trial — the basis of expected-cost and expected-life calculations.
7.3 The Binomial Distribution
Use the binomial when an experiment consists of n identical, independent trials, each ending in “success” or “failure,” with the same success probability p on every trial. Then X = number of successes has:
EQ 7.2P(x) = nCx · pˣ · (1−p)ⁿ⁻ˣ , x = 0, 1, …, n
EQ 7.3μ = np σ = √[np(1−p)]
“Success” is just the outcome being counted — often a defective part! Inspecting n parts from a large lot with defect rate p is the classic engineering binomial.
7.4 The Poisson Distribution
Use the Poisson to count events scattered randomly over an interval of time, length, or area at a constant average rate λ per interval — flaws per panel, calls per minute, failures per year:
EQ 7.4P(x) = e^(−λ) · λˣ / x! , x = 0, 1, 2, …
EQ 7.5μ = λ σ² = λ
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 7.1Example 7.1: Verifying a distribution
The number of paint defects X per hood has distribution: P(0) = 0.50, P(1) = 0.30, P(2) = 0.15, P(3) = 0.05. Verify that this is a valid probability distribution and find P(X ≥ 2).
Solution
Each probability is between 0 and 1, and the sum is 0.50 + 0.30 + 0.15 + 0.05 = 1.00 ✓ — valid.
P(X ≥ 2) = P(2) + P(3) = 0.15 + 0.05 = 0.20.
EX 7.2Example 7.2: Mean and standard deviation of a random variable
For the distribution in Example 7.1, find the mean, variance, and standard deviation of the number of defects per hood.
A process produces 5% defective connectors. Ten connectors are selected at random. Find the probability of (a) no defectives, (b) exactly one defective, (c) at most one defective.
Typical shipments contain 8 ± 3 defectives; a shipment with, say, 20 defectives (z ≈ 4.3) would signal a real process change, not bad luck.
EX 7.5Example 7.5: Poisson probabilities
Surface flaws on aluminum panels occur at an average rate of λ = 3 flaws per panel. Find the probability that a panel has (a) no flaws, (b) exactly two flaws, (c) at least one flaw.
Solution
(a) P(0) = e⁻³(3⁰/0!) = e⁻³ = 0.0498.
(b) P(2) = e⁻³(3²/2!) = e⁻³(4.5) = 0.2240.
(c) P(X ≥ 1) = 1 − P(0) = 1 − 0.0498 = 0.9502.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
7.1 The number of hydraulic leaks X per machine has distribution P(0) = 0.60, P(1) = 0.25, P(2) = 0.10, P(3) = 0.05. Verify the distribution is valid and find P(X ≥ 1).
Answer. Probabilities sum to 1.00 ✓. P(X ≥ 1) = 1 − 0.60 = 0.40.
7.2 For the distribution in Problem 7.1, find μ, σ², and σ.
7.5 A call center receives an average of 2 alarm calls per minute (Poisson). Find (a) P(no calls in a minute), (b) P(exactly 3 calls), (c) P(at least one call).
Measurements — lengths, voltages, times, strengths — are continuous, and their probabilities come from areas under a curve called a probability density function. This chapter introduces the uniform distribution, then the most important curve in all of statistics: the normal (bell) curve, along with the standard normal table, z-scores, and inverse (“work backward”) problems.
8.1 Continuous Random Variables
For a continuous random variable, P(X = one exact value) = 0; only intervals carry probability, computed as area under the density curve. The total area under any density curve is 1. Consequently P(X ≤ a) and P(X < a) are the same for continuous variables.
8.2 The Uniform Distribution
If X is equally likely anywhere between a and b, its density is a flat rectangle of height 1/(b−a). Probability of an interval is simply its length divided by (b−a):
EQ 8.1P(c ≤ X ≤ d) = (d − c)/(b − a) μ = (a+b)/2 σ² = (b−a)²/12
8.3 The Normal Distribution
The normal distribution is a symmetric bell curve completely determined by its mean μ (the center) and standard deviation σ (the spread). It describes measurement error, part dimensions, and — by the Central Limit Theorem of Chapter 9 — sample means of almost anything. The Empirical Rule (68–95–99.7) of Chapter 4 is exact for the normal curve.
8.4 The Standard Normal and z-Table
The standard normal Z has μ = 0 and σ = 1. Any normal X is converted to Z by standardizing:
EQ 8.2z = (x − μ)/σ
A standard normal table (or calculator) gives the cumulative area Φ(z) = P(Z ≤ z). Then:
P(X ≤ x) = Φ(z)
P(X > x) = 1 − Φ(z)
P(a < X < b) = Φ(z_b) − Φ(z_a)
8.5 Inverse Normal Problems
Sometimes the probability is given and the cutoff value is wanted (a warranty life, a spec limit, a percentile). Work backward: find the z-value whose cumulative area matches the given probability, then un-standardize:
EQ 8.3x = μ + z·σ
Useful landmarks: z = 1.28 cuts off the top 10%, z = 1.645 the top 5%, z = 1.96 the top 2.5%, z = 2.33 the top 1%.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 8.1Example 8.1: Uniform distribution
A resistor’s actual resistance is uniformly distributed between 99 and 101 Ω. Find (a) P(X > 100.5), (b) the mean, and (c) the standard deviation.
The bolts of Example 8.3 have specification limits 10.00 ± 0.05 mm. What percentage of production is out of spec?
Solution
Spec limits are 9.95 and 10.05, i.e., z = ±0.05/0.02 = ±2.50.
Area beyond +2.50: 1 − Φ(2.50) = 1 − 0.9938 = 0.0062. By symmetry the same lies below −2.50.
Total out of spec = 2(0.0062) = 0.0124 = 1.24%.
EX 8.5Example 8.5: Inverse normal (working backward)
Bearing lifetimes are normal with μ = 5,000 h and σ = 400 h. The manufacturer wants a warranty life such that only 5% of bearings fail before it. Find the warranty life.
Solution
We need x with P(X < x) = 0.05, i.e., the 5th percentile.
The z-value with 5% area to its left is z = −1.645.
8.3 Fill volumes are normal with μ = 250 mL and σ = 4 mL. Find P(244 < X < 258).
Answer. z = −1.50 and 2.00; P = 0.9772 − 0.0668 = 0.9104.
8.4 For the filler in Problem 8.3, the specification limits are 242 to 258 mL. What percentage of containers is out of spec?
Answer. z = ±2.00; out of spec = 2(0.0228) = 0.0456 = 4.56%.
8.5 Lamp lifetimes are normal with μ = 1,200 h and σ = 100 h. Find the lifetime that only 10% of lamps fail to reach (the 10th percentile).
Answer. z = −1.28; x = 1200 − 1.28(100) = 1,072 hours.
STATISTICS FOR ENGINEERSCH 09SHEET 10 / 19REV A
Chapter 9
Sampling Distributions and the Central Limit Theorem
Every sample gives a slightly different mean. If you repeatedly drew samples of n parts and computed x̄ each time, those means would themselves form a distribution — the sampling distribution of the mean. Understanding how sample means behave is the bridge from descriptive statistics to inference: it is what makes confidence intervals and hypothesis tests possible.
9.1 The Sampling Distribution of the Sample Mean
If a population has mean μ and standard deviation σ, then the collection of all possible sample means x̄ (samples of size n) has:
EQ 9.1μ(x̄) = μ σ(x̄) = σ/√n (the standard error of the mean)
Sample means center on the true mean, and they scatter LESS than individual values — averaging cancels out variation. Quadrupling the sample size halves the standard error.
9.2 The Central Limit Theorem (CLT)
The Central Limit Theorem: for a sufficiently large sample size (n ≥ 30 is the usual rule of thumb), the sampling distribution of x̄ is approximately NORMAL — regardless of the shape of the population. If the population itself is normal, x̄ is exactly normal for any n.
To find probabilities about a sample mean, standardize with the standard error:
EQ 9.2z = (x̄ − μ) / (σ/√n)
9.3 The Sampling Distribution of a Proportion
A sample proportion p̂ = x/n from a population with true proportion p has:
EQ 9.3μ(p̂) = p σ(p̂) = √[ p(1−p)/n ]
and is approximately normal when np ≥ 10 and n(1−p) ≥ 10. Standardize with:
EQ 9.4z = (p̂ − p) / √[ p(1−p)/n ]
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 9.1Example 9.1: Standard error
IQ-style test scores of applicants have μ = 100 and σ = 15. For random samples of n = 36 applicants, find the mean and standard error of the sampling distribution of x̄.
Solution
μ(x̄) = μ = 100.
σ(x̄) = σ/√n = 15/√36 = 15/6 = 2.5.
Sample means of 36 applicants cluster around 100 with a spread of only 2.5 — six times tighter than individual scores.
EX 9.2Example 9.2: Probability for a sample mean
For the population in Example 9.1, find the probability that a random sample of 36 has a mean greater than 105.
Solution
z = (105 − 100)/2.5 = 2.00.
P(x̄ > 105) = 1 − Φ(2.00) = 1 − 0.9772 = 0.0228.
Only about a 2.3% chance — a sample mean of 105 from this population would be unusual.
P(p̂ < 0.15) = Φ(−1.25) = 0.1056 — about an 11% chance.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
9.1 Cable tensile strengths have μ = 50 kN and σ = 8 kN. For samples of n = 16, find the mean and standard error of x̄.
Answer. μ(x̄) = 50 kN; σ(x̄) = 8/√16 = 2 kN.
9.2 The population in Problem 9.1 is normal. Find P(x̄ > 53) for n = 16.
Answer. z = (53 − 50)/2 = 1.50; P = 1 − 0.9332 = 0.0668.
9.3 Cure times have μ = 200 s and σ = 30 s. For samples of n = 36, find P(195 < x̄ < 210).
Answer. SE = 5; z = −1.00 and 2.00; P = 0.9772 − 0.1587 = 0.8185.
9.4 Repair costs are right-skewed with μ = $75 and σ = $20. For samples of n = 100 invoices, find P(x̄ < 71) and state why the normal curve may be used.
Answer. SE = 2; z = −2.00; P = 0.0228. Valid because n = 100 ≥ 30, so the CLT makes x̄ approximately normal despite the skewed population.
9.5 A process runs at p = 0.10 nonconforming. For samples of n = 225, find P(p̂ > 0.13).
Answer. SE = √[0.10(0.90)/225] = 0.02; z = 1.50; P = 1 − 0.9332 = 0.0668.
STATISTICS FOR ENGINEERSCH 10SHEET 11 / 19REV A
Chapter 10
Confidence Intervals
A sample mean is a single guess — a point estimate — and it is almost certainly not exactly equal to the true population mean. A confidence interval turns the point estimate into an honest range: estimate ± margin of error, together with a confidence level (usually 90%, 95%, or 99%) describing how reliable the procedure is. This chapter builds intervals for a mean (σ known and unknown) and for a proportion, and shows how to choose the sample size needed for a target precision.
10.1 Confidence Interval for a Mean, σ Known (z-Interval)
EQ 10.1x̄ ± z(α/2) · σ/√n
The critical values are z = 1.645 for 90%, 1.96 for 95%, and 2.576 for 99% confidence. The quantity after the ± sign is the margin of error E.
Interpretation: “95% confident” means the procedure captures the true mean in 95% of all samples — not that there is a 95% probability μ is inside this one interval. μ is a fixed number; it is the interval that varies from sample to sample.
10.2 Confidence Interval for a Mean, σ Unknown (t-Interval)
In practice σ is rarely known; we estimate it with s, which adds uncertainty. The correction is Student’s t distribution — bell-shaped but slightly wider than z, with df = n − 1 degrees of freedom:
EQ 10.2x̄ ± t(α/2, n−1) · s/√n
As n grows, t approaches z. Requirements: a random sample, and either a roughly normal population or a large n.
10.3 Confidence Interval for a Proportion
EQ 10.3p̂ ± z(α/2) · √[ p̂(1−p̂)/n ]
valid when np̂ ≥ 10 and n(1−p̂) ≥ 10 (at least 10 “successes” and 10 “failures” in the sample).
10.4 Choosing the Sample Size
To achieve a desired margin of error E, solve for n and always round UP:
EQ 10.4Mean: n = ( z·σ / E )² Proportion: n = p̂(1−p̂)·( z / E )²
If no prior estimate of the proportion exists, use p̂ = 0.5, which gives the largest (safest) sample size.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 10.1Example 10.1: z-interval for a mean
A filling machine has known σ = 3.0 g. A sample of n = 36 packages has x̄ = 72.5 g. Construct a 95% confidence interval for the true mean fill weight.
Solution
Standard error: σ/√n = 3.0/6 = 0.5.
Margin of error: E = 1.96(0.5) = 0.98.
Interval: 72.5 ± 0.98 → (71.52, 73.48) g.
We are 95% confident the true mean fill weight is between 71.52 and 73.48 g.
EX 10.2Example 10.2: Effect of the confidence level
Repeat Example 10.1 at 90% confidence and compare the two intervals.
Solution
E = 1.645(0.5) = 0.8225.
Interval: 72.5 ± 0.82 → (71.68, 73.32) g.
The 90% interval is narrower than the 95% interval. Higher confidence always costs a wider interval; the only way to gain both confidence and precision is a larger sample.
EX 10.3Example 10.3: t-interval for a mean
Sixteen concrete cylinders have mean strength x̄ = 24.8 MPa with s = 1.2 MPa. Assuming approximate normality, build a 95% confidence interval for the true mean strength.
Solution
σ is unknown → use t with df = 16 − 1 = 15: t(0.025, 15) = 2.131.
Standard error: s/√n = 1.2/4 = 0.3.
E = 2.131(0.3) = 0.6393.
Interval: 24.8 ± 0.64 → (24.16, 25.44) MPa.
EX 10.4Example 10.4: Confidence interval for a proportion
Of 150 welds inspected, 45 required rework. Build a 95% confidence interval for the true rework proportion.
Standard error: √[0.30(0.70)/150] = √0.0014 = 0.0374.
E = 1.96(0.0374) = 0.0733.
Interval: 0.30 ± 0.0733 → (0.227, 0.373). Between about 23% and 37% of all welds need rework.
EX 10.5Example 10.5: Sample size
(a) How many parts must be measured to estimate a mean within E = 2.0 units at 95% confidence if σ ≈ 8? (b) How many customers must be surveyed to estimate a proportion within 0.05 at 95% confidence with no prior estimate?
Solution
(a) n = (zσ/E)² = (1.96 × 8 / 2)² = (7.84)² = 61.47 → round up: n = 62.
(b) With p̂ = 0.5: n = 0.25(1.96/0.05)² = 0.25(1536.64) = 384.16 → n = 385.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
10.1 A process has known σ = 7. A sample of n = 49 gives x̄ = 118. Construct a 95% confidence interval for μ.
Answer. SE = 1; E = 1.96; interval (116.04, 119.96).
10.2 Using the data of Problem 10.1, construct a 99% confidence interval and state how it compares to the 95% interval.
Answer. E = 2.576(1) = 2.576; interval (115.42, 120.58) — wider than the 95% interval.
10.3 Twenty-five oil samples have x̄ = 8.35 (viscosity index) with s = 0.90. Build a 95% t-interval for the true mean.
Answer. df = 24, t = 2.064; SE = 0.18; E = 0.3715; interval (7.98, 8.72).
10.4 In a sample of 240 molded parts, 60 show flash defects. Build a 95% confidence interval for the true defect proportion.
Answer. p̂ = 0.25; SE = 0.02795; E = 0.0548; interval (0.195, 0.305).
10.5 (a) With σ ≈ 12, what sample size estimates a mean within E = 3 at 95% confidence? (b) What sample size estimates a proportion within E = 0.04 at 95% confidence with no prior estimate?
Answer. (a) n = (1.96·12/3)² = 61.47 → 62. (b) n = 0.25(1.96/0.04)² = 600.25 → 601.
STATISTICS FOR ENGINEERSCH 11SHEET 12 / 19REV A
Chapter 11
Hypothesis Testing: One Sample
A hypothesis test answers a yes-or-no question about a population: Has the mean shifted from its target? Is the defect rate above the contract limit? The logic is proof by contradiction: assume the status quo (the null hypothesis), compute how surprising your sample would be under that assumption, and reject the assumption only when the data are too surprising to believe.
11.1 Hypotheses, Errors, and Significance Level
The null hypothesis H₀ states the status quo with equality (μ = μ₀ or p = p₀). The alternative H₁ is what you seek evidence for: two-tailed (≠), left-tailed (<), or right-tailed (>).
Two errors are possible. A Type I error rejects a true H₀ (a false alarm); its probability is the significance level α, chosen in advance (commonly 0.05). A Type II error fails to reject a false H₀ (a missed detection); its probability is β. Decreasing α raises β unless the sample size increases.
11.2 The Test Procedure
Step 1. State H₀ and H₁, and choose α.
Step 2. Compute the test statistic from the sample.
Step 3. Find the critical value(s) for α, or compute the p-value.
Step 4. Decide: reject H₀ if the statistic falls in the rejection region (equivalently, if p-value ≤ α).
Step 5. State the conclusion in plain language, in context.
The p-value is the probability, assuming H₀ is true, of a sample result at least as extreme as the one observed. Small p-value → the data are inconsistent with H₀.
11.3 Test for a Mean
EQ 11.1σ known: z = (x̄ − μ₀)/(σ/√n) σ unknown: t = (x̄ − μ₀)/(s/√n), df = n − 1
11.4 Test for a Proportion
EQ 11.2z = (p̂ − p₀) / √[ p₀(1−p₀)/n ]
valid when np₀ ≥ 10 and n(1−p₀) ≥ 10. Note that the standard error uses the hypothesized p₀, not p̂ — under H₀ we must assume p₀ is the truth.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 11.1Example 11.1: Writing hypotheses
Write H₀ and H₁ for each situation: (a) a filler is supposed to deliver 500 g and either direction of error matters; (b) a supplier claims the defect rate is at most 5% and the buyer suspects it is higher; (c) a redesign is supposed to increase mean battery life above 40 h.
Solution
(a) H₀: μ = 500 vs. H₁: μ ≠ 500 (two-tailed).
(b) H₀: p = 0.05 vs. H₁: p > 0.05 (right-tailed).
(c) H₀: μ = 40 vs. H₁: μ > 40 (right-tailed). The claim to be demonstrated goes in H₁.
EX 11.2Example 11.2: z-test for a mean (σ known)
A filler is set to μ₀ = 500 g with known σ = 14 g. A sample of n = 49 packages has x̄ = 495 g. At α = 0.05, has the mean fill changed?
Solution
H₀: μ = 500 vs. H₁: μ ≠ 500; α = 0.05.
z = (495 − 500)/(14/√49) = −5/2 = −2.50.
Critical values: ±1.96. Since −2.50 < −1.96, reject H₀.
Conclusion: the mean fill has drifted below 500 g; the machine needs adjustment.
EX 11.3Example 11.3: t-test for a mean (σ unknown)
Fastener torque should average 5.0 N·m. A sample of 25 fasteners gives x̄ = 5.23 and s = 0.24. Test at α = 0.05 (two-tailed) whether the mean differs from 5.0.
Conclusion: strong evidence the mean torque is not 5.0 N·m (it is running high).
EX 11.4Example 11.4: z-test for a proportion
Warranty claims have historically run at 10%. After a design change, 28 of 200 units generate claims. At α = 0.05, is the claim rate now higher than 10%?
Solution
H₀: p = 0.10 vs. H₁: p > 0.10. Check: np₀ = 20, n(1−p₀) = 180 ✓.
p̂ = 28/200 = 0.14. SE = √[0.10(0.90)/200] = 0.0212.
z = (0.14 − 0.10)/0.0212 = 1.89.
Critical value 1.645 (right-tailed). Since 1.89 > 1.645, reject H₀. p-value = 1 − Φ(1.89) = 0.0294.
Conclusion: evidence at the 5% level that the claim rate has increased.
EX 11.5Example 11.5: Interpreting p-values and errors
A test of H₀: μ = 30 produces p-value = 0.03. (a) What is the decision at α = 0.05? At α = 0.01? (b) Describe what a Type I and Type II error would mean if μ is the mean lead time a customer is promised.
Solution
(a) At α = 0.05: 0.03 ≤ 0.05 → reject H₀. At α = 0.01: 0.03 > 0.01 → fail to reject. The decision can depend on how much false-alarm risk you accept.
(b) Type I error: concluding the lead time has changed when it really is still 30 days — triggering an unnecessary process overhaul.
Type II error: concluding nothing changed when the lead time really has shifted — customers keep receiving late orders.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
11.1 Write H₀ and H₁: (a) a rod diameter must equal 25 mm, either direction bad; (b) a new coating is claimed to make corrosion resistance exceed 900 h; (c) a firm suspects its scrap rate has fallen below 8%.
11.2 A beverage filler targets 12.00 oz with known σ = 0.18 oz. A sample of 36 bottles averages 11.92 oz. Test H₀: μ = 12 vs. H₁: μ ≠ 12 at α = 0.05, and give the p-value.
Answer. SE = 0.03; z = −2.67; critical ±1.96 → reject H₀. p-value = 2(0.0038) = 0.0076. The filler is under-filling.
11.3 Sixteen specimens of an alloy have x̄ = 102.3 ksi and s = 4.0 ksi. Test whether the mean strength differs from 100 ksi at α = 0.05.
Answer. t = 2.3/(4/4) = 2.30; df = 15, critical ±2.131 → reject H₀; the mean differs from 100 ksi.
11.4 A contract allows at most 5% defective. In a sample of 400 units, 28 are defective. Test H₀: p = 0.05 vs. H₁: p > 0.05 at α = 0.05.
Answer. p̂ = 0.07; SE = √[0.05(0.95)/400] = 0.0109; z = 1.84 > 1.645 → reject H₀ (p ≈ 0.033); defect rate exceeds the contract limit.
11.5 A test yields p-value = 0.12 with α = 0.05. State the decision, and explain which type of error is now possible and what it would mean in practice.
Answer. Fail to reject H₀. A Type II error is now possible: the process may truly have changed, but the test missed it (insufficient evidence).
STATISTICS FOR ENGINEERSCH 12SHEET 13 / 19REV A
Chapter 12
Hypothesis Testing: Two Samples
Engineering questions are usually comparisons: Is vendor A stronger than vendor B? Did the process change reduce defects? Does the new fixture cut cycle time on the same machines? This chapter compares two means from independent samples, two means from paired (before/after) data, and two proportions.
12.1 Independent Samples vs. Paired Data
Two samples are independent when the individuals in one sample have no connection to those in the other (parts from vendor A vs. parts from vendor B). Data are paired when each observation in one sample is naturally matched to one in the other — the same machine before and after an upgrade, the same specimen measured by two gauges. Pairing removes unit-to-unit variation and usually gives a more sensitive test. Choosing the wrong analysis is one of the most common statistical mistakes.
12.2 Comparing Two Means: Independent Samples (Pooled t)
When the two populations are roughly normal with similar variances, pool the two sample variances:
A confidence interval for the difference of means is (x̄₁ − x̄₂) ± t(α/2)·sp·√(1/n₁ + 1/n₂). If the interval contains 0, the data are consistent with “no difference.”
12.3 Comparing Two Means: Paired Data
Compute the difference d for each pair, then run a one-sample t-test on the differences:
EQ 12.3t = d̄ / (s_d/√n) , df = n − 1
where n is the number of pairs, d̄ the mean difference, and s_d the standard deviation of the differences.
12.4 Comparing Two Proportions
To test H₀: p₁ = p₂, pool the successes to estimate the common proportion p̄ = (x₁ + x₂)/(n₁ + n₂):
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 12.1Example 12.1: Pooled two-sample t-test
Ten specimens of alloy 1 average x̄₁ = 82 MPa with s₁ = 4; ten specimens of alloy 2 average x̄₂ = 78 MPa with s₂ = 5. At α = 0.05, do the mean strengths differ?
The interval contains 0, agreeing with the test: alloy 1 might be as much as 8 MPa stronger, but the data cannot rule out no difference at all.
EX 12.3Example 12.3: Paired t-test
Cycle times (s) were measured on five machines before and after a fixture upgrade; the improvements (before − after) are d = 2, 3, 1, 4, 2. At α = 0.05, does the upgrade reduce cycle time?
Solution
H₀: μ_d = 0 vs. H₁: μ_d > 0 (an improvement means positive d).
d̄ = (2+3+1+4+2)/5 = 2.4. Deviations: −0.4, 0.6, −1.4, 1.6, −0.4; squares sum to 5.2.
s_d² = 5.2/4 = 1.3, so s_d = 1.1402 and SE = 1.1402/√5 = 0.5099.
t = 2.4/0.5099 = 4.71 with df = 4; critical t(0.05, 4) = 2.132.
Since 4.71 > 2.132, reject H₀ — the upgrade genuinely reduces cycle time (by about 2.4 s on average).
EX 12.4Example 12.4: Two-proportion z-test
Machine A produced 30 defectives in 200 parts; machine B produced 45 defectives in 200 parts. At α = 0.05, do the defect rates differ?
SE = √[0.1875(0.8125)(1/200 + 1/200)] = √0.001523 = 0.0390.
z = (0.15 − 0.225)/0.0390 = −1.92.
Critical values ±1.96. Since |−1.92| < 1.96, fail to reject H₀ (p-value ≈ 0.055).
The observed gap is suggestive but just short of significance at the 5% level; a larger sample would settle the question.
EX 12.5Example 12.5: Choosing the right two-sample test
For each study, state whether the analysis should be an independent-samples t, a paired t, or a two-proportion z: (a) hardness of 15 parts heat-treated in oven 1 vs. 15 different parts in oven 2; (b) fuel economy of 8 trucks measured with the old tire and again with the new tire; (c) fraction of late shipments this quarter vs. last quarter.
Solution
(a) Independent-samples t — different parts in each group, comparing two means.
(b) Paired t — the same 8 trucks are measured twice; each truck is its own control.
(c) Two-proportion z — comparing two fractions (late vs. on-time counts).
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
12.1 Eight parts from process 1: x̄₁ = 150, s₁ = 6. Eight parts from process 2: x̄₂ = 144, s₂ = 8. Test H₀: μ₁ = μ₂ vs. H₁: μ₁ ≠ μ₂ at α = 0.05 using the pooled t-test.
Answer. sp² = [7(36) + 7(64)]/14 = 50; sp = 7.071; SE = 3.536; t = 6/3.536 = 1.70; df = 14, critical ±2.145 → fail to reject H₀.
12.2 Using the data of Problem 12.1, construct a 95% confidence interval for μ₁ − μ₂ and interpret it.
12.3 Surface roughness was measured on five shafts before and after a polishing change; improvements are d = 3, 5, 2, 6, 4. Test at α = 0.05 whether the change reduces roughness (H₁: μ_d > 0).
Answer. d̄ = 4; s_d = √(10/4) = 1.5811; SE = 0.7071; t = 5.66; df = 4, critical 2.132 → reject H₀; the change reduces roughness.
12.4 Line 1 had 24 defectives in 300 units; line 2 had 42 defectives in 300 units. Test at α = 0.05 whether the defect rates differ.
12.5 Classify the correct analysis (independent t, paired t, or two-proportion z): (a) breaking strength of 12 welds by robot vs. 12 welds by hand; (b) the same 10 circuit boards tested at 25 °C and again at 85 °C; (c) proportion of passed inspections for shift A vs. shift B.
Answer. (a) independent t; (b) paired t; (c) two-proportion z.
STATISTICS FOR ENGINEERSCH 13SHEET 14 / 19REV A
Chapter 13
Correlation and Simple Linear Regression
Many engineering questions involve two variables: does higher curing temperature increase strength? Does spindle speed affect surface finish? Correlation measures how strongly two quantitative variables move together; regression fits the best straight line through the data so you can predict one variable from the other.
13.1 Scatter Plots and the Correlation Coefficient
Always start with a scatter plot of the pairs (x, y): x is the explanatory (independent) variable, y the response (dependent) variable. Look for direction (positive or negative), form (linear or curved), strength, and outliers.
The linear correlation coefficient r measures the strength and direction of a LINEAR relationship, with −1 ≤ r ≤ +1. Values near ±1 indicate a tight line; values near 0 indicate no linear relationship. A convenient computing route uses three sums of squares:
The least-squares line ŷ = b₀ + b₁x minimizes the total squared vertical error between the data points and the line:
EQ 13.3b₁ = Sxy / Sxx b₀ = ȳ − b₁·x̄
The slope b₁ is the predicted change in y for each one-unit increase in x. The intercept b₀ is the prediction at x = 0 (meaningful only if x = 0 makes physical sense).
13.3 Prediction, Residuals, and r²
A residual is (observed − predicted) = y − ŷ; the line runs through the “middle” of the residuals, which sum to zero. The coefficient of determination r² is the fraction of the variation in y explained by the linear relationship with x — an r of 0.9 means r² = 0.81, i.e., 81% of the variation is explained.
Two cautions: never extrapolate far outside the range of the x-data, and never trust a fitted line you have not plotted.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 13.1Example 13.1: Reading a scatter plot
Describe the relationship you would expect in a scatter plot of: (a) cutting speed vs. tool life; (b) ambient temperature vs. solar panel output over a mild range; (c) part serial number vs. mass.
Solution
(a) Negative association — higher speeds wear tools faster, so tool life falls as speed rises.
(b) Positive association over a mild range — more sun (warmer days) generally means more output. (At extreme heat, efficiency drops, so the pattern could curve.)
(c) No association — serial numbers are labels; mass should scatter randomly across them.
EX 13.2Example 13.2: Computing r
For five test runs, x = 1, 2, 3, 4, 5 and y = 2, 4, 5, 4, 5. Compute the correlation coefficient.
Residual = observed − predicted = 54 − 55.4 = −1.4 percentage points; the model slightly over-predicts this run.
EX 13.5Example 13.5: Interpreting r²
For the temperature–yield data, Syy = 273.2 and Sxy = 520 with Sxx = 1000. Compute r and r², and interpret r². Would you trust the line to predict yield at 220 °C?
Solution
r = 520/√(1000 × 273.2) = 520/522.68 = 0.9949.
r² = 0.9898 — about 99% of the variation in yield is explained by its linear relationship with temperature. An excellent fit.
No prediction at 220 °C should be trusted: it lies far outside the observed range (100–140 °C). The relationship could bend, level off, or fail entirely out there — extrapolation is speculation.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
13.1 Predict the direction of association (positive, negative, or none): (a) hours of machine use vs. remaining bearing life; (b) weld current vs. weld penetration depth over the normal range; (c) operator badge number vs. parts per hour.
Answer. (a) negative; (b) positive; (c) none.
13.2 For x = 2, 4, 6, 8 and y = 3, 7, 5, 9, compute Sxx, Syy, Sxy, and the correlation coefficient r.
13.5 For the data of Problem 13.3, Syy = 40.8. Compute r and r², and state in words what r² means here.
Answer. r = 20/√(10 × 40.8) = 0.9901; r² = 0.9803 — about 98% of the variation in output is explained by hours of machine use.
STATISTICS FOR ENGINEERSCH 14SHEET 15 / 19REV A
Chapter 14
Chi-Square Tests: Goodness of Fit and Independence
Not all data are measurements — much engineering data are counts in categories: defect types, vendors, shifts, pass/fail grades. Chi-square (χ²) tests compare observed counts with the counts expected under a hypothesis. The goodness-of-fit test checks whether one categorical variable follows a claimed distribution; the test of independence checks whether two categorical variables are related.
14.1 The Chi-Square Statistic
Both tests use the same statistic, summed over all categories or cells:
EQ 14.1χ² = Σ (O − E)² / E
where O is the observed count and E is the expected count under H₀. Large χ² means the observed data are far from what H₀ predicts, so chi-square tests are always right-tailed. Requirement: every expected count should be at least 5.
14.2 Goodness-of-Fit Test
H₀ states the claimed category proportions. Each expected count is E = n × (claimed proportion). Degrees of freedom: df = k − 1, where k is the number of categories. Reject H₀ when χ² exceeds the critical value χ²(α, k−1).
14.3 Test of Independence
Counts are arranged in a contingency table of r rows and c columns. H₀: the row variable and column variable are independent. Expected counts come from the table margins:
EQ 14.2E = (row total × column total) / grand total
EQ 14.3df = (r − 1)(c − 1)
Rejecting H₀ means the two variables are associated — for example, defect rate depends on which shift produced the part.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 14.1Example 14.1: Goodness of fit, equal proportions
A six-position indexing table should stop at each position equally often. In 60 cycles the stops were: 8, 12, 9, 11, 10, 10. At α = 0.05, is the table consistent with equal probabilities?
Solution
H₀: each position has probability 1/6. Expected count each: E = 60/6 = 10.
Since 4.00 < 5.991, fail to reject H₀ — the data do not demonstrate a quality difference between vendors.
EX 14.5Example 14.5: Checking the conditions
A planned 3 × 4 contingency-table analysis of 90 observations has one column with a total of only 12. (a) What are the degrees of freedom? (b) What condition must be verified before running the test, and what can be done if it fails?
Solution
(a) df = (3 − 1)(4 − 1) = 6.
(b) Every expected count must be at least 5. A column total of 12 spread over 3 rows can easily produce expected counts below 5 (e.g., 12 × 20/90 = 2.7).
If expected counts fall below 5, combine adjacent categories (or collect more data) before testing; otherwise the χ² approximation is unreliable.
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
14.1 Four identical machines should share breakdowns equally. Of 80 breakdowns: machine 1 had 26, machine 2 had 18, machine 3 had 22, machine 4 had 14. Test at α = 0.05 whether breakdowns are equally likely.
Answer. E = 20 each; χ² = (36 + 4 + 4 + 36)/20 = 4.00; df = 3, critical 7.815 → fail to reject; no significant difference among machines.
14.2 A supplier claims its shipments grade 60% premium, 25% standard, 15% economy. In 200 shipments you observe 105, 60, and 35. Test the claim at α = 0.05.
Answer. E = 120, 50, 30; χ² = 1.875 + 2.00 + 0.833 = 4.71; df = 2, critical 5.991 → fail to reject the claim.
14.3 Material X: 12 cracked, 88 sound. Material Y: 24 cracked, 76 sound. Test at α = 0.05 whether cracking is independent of material.
14.4 A 2 × 3 table has row totals 150 and 150, and column totals 90, 120, 90 (n = 300). Compute the six expected counts.
Answer. Row 1: 45, 60, 45. Row 2: 45, 60, 45.
14.5 For a 4 × 3 contingency table: (a) find the degrees of freedom; (b) state the expected-count condition that must be checked before testing.
Answer. (a) df = (4−1)(3−1) = 6; (b) every expected count must be at least 5 (combine categories or gather more data if not).
STATISTICS FOR ENGINEERSCH 15SHEET 16 / 19REV A
Chapter 15
One-Way Analysis of Variance (ANOVA)
The two-sample t-test compares two means. But engineers often compare three or more: three suppliers, four cure temperatures, five machines. Running many t-tests inflates the chance of a false alarm; one-way ANOVA tests all the means at once with a single F-test by asking a simple question — is the variation BETWEEN group means large compared with the variation WITHIN groups?
15.1 The Logic and Hypotheses of ANOVA
EQ 15.1H₀: μ₁ = μ₂ = ··· = μk H₁: at least one mean differs
ANOVA splits the total variation in the data into two parts: SSB, the sum of squares between groups (how far the group means are from the grand mean), and SSW, the sum of squares within groups (ordinary scatter inside each group). If H₀ is true, both reflect only random noise and their ratio is near 1; if some means differ, SSB inflates.
Assumptions: independent random samples, roughly normal populations, and roughly equal group variances.
15.2 The F Statistic and the ANOVA Table
With k groups and N total observations (group sizes nⱼ, group means x̄ⱼ, grand mean x̄̄):
EQ 15.2SSB = Σ nⱼ(x̄ⱼ − x̄̄)² SSW = Σ (each value − its group mean)²
Reject H₀ when F exceeds the critical value F(α; k−1, N−k). The results are conventionally displayed in an ANOVA table with columns Source, SS, df, MS, F.
15.3 After ANOVA
A significant F says only that SOME difference exists. To find which means differ, examine the group means and follow up with multiple-comparison procedures (such as Tukey’s method, covered in later courses). Always report the group means alongside the ANOVA table — the sizes of the differences matter as much as their significance.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 15.1Example 15.1: Setting up the hypotheses
An engineer will compare the mean tensile strengths of parts from three suppliers using ANOVA. State the hypotheses and explain why three separate t-tests are a poor substitute.
Solution
H₀: μA = μB = μC (all supplier means equal) vs. H₁: at least one supplier mean differs.
Three t-tests (A–B, A–C, B–C) each carry a 5% false-alarm risk; together the chance of at least one false alarm grows to roughly 14%.
ANOVA tests everything at once while holding the overall Type I error at α.
EX 15.2Example 15.2: Complete one-way ANOVA
Bond strengths (MPa) for three adhesive suppliers, four samples each — A: 20, 21, 19, 20; B: 22, 24, 23, 23; C: 19, 18, 20, 19. Test at α = 0.05 whether the supplier means differ.
Solution
Group means: x̄A = 20, x̄B = 23, x̄C = 19. Grand mean: x̄̄ = 248/12 = 20.667.
Since 3.56 > 3.24, reject H₀ — at least one coating mean differs.
EX 15.4Example 15.4: Using the F distribution
An ANOVA compares k = 3 processes with N = 15 observations and yields F = 2.50. Find the degrees of freedom and the decision at α = 0.05.
Solution
df numerator = k − 1 = 2; df denominator = N − k = 12.
Critical value F(0.05; 2, 12) = 3.89.
Since 2.50 < 3.89, fail to reject H₀ — the data do not demonstrate a difference among the three process means.
EX 15.5Example 15.5: Interpreting a significant result
An ANOVA of four machines rejects H₀ with F = 8.2, and the machine means are 51, 50, 50.5, and 46 units/hr. What conclusions and next steps are appropriate?
Solution
The significant F says the four means are not all equal, but not which ones differ.
Inspecting the means, machine 4 (46) sits well below the others, which cluster near 50–51 — the likely source of the significance.
Next steps: confirm with a multiple-comparison procedure, then investigate machine 4 for an assignable cause (worn tooling, calibration, setup).
Practice problems
Each problem mirrors the matching worked example above. Reveal an answer only after you have attempted the problem.
15.1 State the ANOVA hypotheses for comparing the mean cycle times of four CNC machines, and explain the advantage over six pairwise t-tests.
Answer. H₀: μ₁ = μ₂ = μ₃ = μ₄ vs. H₁: at least one differs. One F-test holds the overall false-alarm rate at α; six t-tests inflate it well above 5%.
15.2 Etch rates for three bath temperatures, four wafers each — T1: 10, 12, 11, 11; T2: 14, 13, 15, 14; T3: 12, 12, 13, 11. Run the complete ANOVA at α = 0.05.
Answer. Means 11, 14, 12; grand mean 12.333. SSB = 4(1.778 + 2.778 + 0.111) = 18.667; SSW = 2 + 2 + 2 = 6; MSB = 9.333, MSW = 0.667; F = 14.0 > F(2, 9) = 4.26 → reject H₀; temperature affects etch rate.
15.3 A study with k = 3 and N = 18 gives SST = 90 and SSB = 30. Complete the ANOVA table and test at α = 0.05 [use F(0.05; 2, 15) = 3.68].
15.4 An ANOVA with k = 4 groups and N = 24 observations gives F = 2.90. Find both df values and the decision at α = 0.05 [use F(0.05; 3, 20) = 3.10].
Answer. df = 3 and 20; 2.90 < 3.10 → fail to reject H₀.
15.5 Explain why an engineer should not simply run a t-test on the largest and smallest of five group means as a substitute for ANOVA.
Answer. Picking the extreme means after seeing the data inflates the Type I error badly — the comparison was chosen BECAUSE it looked large. ANOVA (then proper multiple comparisons) controls this.
STATISTICS FOR ENGINEERSCH 16SHEET 17 / 19REV A
Chapter 16
Statistical Quality Control: Control Charts and Process Capability
This capstone chapter applies everything — means, ranges, the normal curve, sampling distributions, hypothesis-testing logic — to the daily work of keeping a manufacturing process healthy. Control charts detect when a process changes; capability indices measure whether a stable process can actually meet its specification limits.
16.1 Common-Cause and Special-Cause Variation
Every process varies. Common-cause variation is the steady background noise inherent to the process; a process showing only common causes is in statistical control and is predictable. Special-cause (assignable) variation comes from something specific — a tool breaks, a new material lot, a setup error. Control charts exist to flag special causes quickly, so they can be found and removed, while leaving a stable process alone.
16.2 x̄ and R Charts
Small subgroups (typically n = 4 or 5 consecutive parts) are sampled periodically. Each subgroup yields a mean x̄ and a range R. With x̄̄ = the average of the subgroup means and R̄ = the average range, the 3-sigma control limits are:
A process is judged out of control if any point falls outside the limits, or if non-random patterns appear (runs of 8+ points on one side of the centerline, steady trends, cycles). Check the R chart first — if spread is unstable, the x̄ chart limits mean nothing.
16.3 Process Capability: Cp and Cpk
Control answers “is the process stable?”; capability answers “can it meet spec?” For a stable process with standard deviation σ and specification limits LSL and USL:
EQ 16.3Cp = (USL − LSL) / (6σ)
EQ 16.4Cpk = min[ (USL − μ), (μ − LSL) ] / (3σ)
Cp compares the spec width to the natural process width (6σ) but ignores centering; Cpk penalizes a process that is off-center. Cpk = Cp only when the process is perfectly centered. Common benchmarks: Cpk ≥ 1.00 is minimally capable (about 0.27% out of spec if centered); Cpk ≥ 1.33 is the usual industrial requirement.
Worked examples
Try each example with pencil and calculator first, then open the solution and check yourself line by line.
EX 16.1Example 16.1: x̄ chart limits
Twenty subgroups of n = 5 shaft diameters give x̄̄ = 50.00 mm and R̄ = 4.00 (in 0.01 mm units, i.e., R̄ represents the average range). Compute the x̄ chart centerline and control limits.
Solution
For n = 5, A₂ = 0.577.
Centerline = x̄̄ = 50.00.
UCL = 50.00 + 0.577(4.00) = 50.00 + 2.31 = 52.31.
LCL = 50.00 − 2.31 = 47.69.
Future subgroup means should fall between 47.69 and 52.31 if the process stays stable.
EX 16.2Example 16.2: R chart limits
For the process in Example 16.1, compute the R chart limits.
Solution
For n = 5, D₄ = 2.114 and D₃ = 0.
Centerline = R̄ = 4.00.
UCL = 2.114(4.00) = 8.46.
LCL = 0(4.00) = 0.
Subgroup ranges above 8.46 would signal that process spread has increased.
EX 16.3Example 16.3: Judging control
Using the limits of Example 16.1 (47.69 to 52.31), the next six subgroup means are 49.8, 50.6, 51.2, 52.6, 50.1, 49.5. Is the process in control?
Solution
Compare each mean with the limits: 49.8 ✓, 50.6 ✓, 51.2 ✓, 52.6 ✗ (above UCL = 52.31), 50.1 ✓, 49.5 ✓.
The fourth subgroup falls outside the upper control limit.
The process is out of control at that point: stop, look for a special cause (tool wear, setup change, material lot), fix it, and only then resume — do not simply recalculate the limits.
EX 16.4Example 16.4: Cp
A dimension has specification 10.00 ± 0.50 mm (LSL = 9.50, USL = 10.50), and the stable process has σ = 0.15 mm. Compute Cp and interpret it.
16.3 Using your limits from Problem 16.1, judge the process from the subgroup means 24.5, 25.2, 27.4, 25.0, 24.8, and state the correct response.
Answer. 27.4 exceeds UCL = 27.19 → out of control at subgroup 3; stop and hunt for the special cause before continuing (do not recompute limits to hide it).
16.4 A specification runs from LSL = 48 to USL = 52, and the process σ = 0.50. Compute Cp.
Answer. Cp = 4/(6 × 0.5) = 1.33.
16.5 The process in Problem 16.4 is centered at μ = 50.8. Compute Cpk, compare it with Cp, and recommend an action.
Answer. Cpk = min(52 − 50.8, 50.8 − 48)/(3 × 0.5) = 1.2/1.5 = 0.80. Cpk (0.80) is far below Cp (1.33) because the process is off-center; re-center near 50.0 to recover capability.
STATISTICS FOR ENGINEERSAPP BSHEET 18 / 19REV A
Appendix B
Quick formula reference
Every formula used in the book, grouped by topic. Intermediate results are usually carried to four decimal places.
Descriptive Statistics
Sample mean
x̄ = Σx / n
Weighted mean
x̄w = Σ(w·x) / Σw
Grouped mean
x̄ ≈ Σ(f·m) / n
Sample variance
s² = Σ(x − x̄)²/(n−1) = [Σx² − (Σx)²/n]/(n−1)
Coefficient of variation
CV = (s/x̄) × 100%
z-score
z = (x − μ)/σ
IQR and outlier fences
IQR = Q3 − Q1; fences at Q1 − 1.5·IQR and Q3 + 1.5·IQR
Probability
Complement
P(E′) = 1 − P(E)
Addition rule
P(A or B) = P(A) + P(B) − P(A and B)
Conditional probability
P(A|B) = P(A and B)/P(B)
Independent events
P(A and B) = P(A)·P(B)
Permutations / combinations
nPr = n!/(n−r)! nCr = n!/[r!(n−r)!]
Distributions
Discrete RV mean, variance
μ = Σx·P(x); σ² = Σx²·P(x) − μ²
Binomial
P(x) = nCx·pˣ(1−p)ⁿ⁻ˣ; μ = np; σ = √[np(1−p)]
Poisson
P(x) = e^(−λ)λˣ/x!; μ = σ² = λ
Uniform (a, b)
μ = (a+b)/2; σ² = (b−a)²/12
Standardizing a normal
z = (x − μ)/σ; inverse: x = μ + zσ
Sampling Distributions
Standard error of the mean
σ(x̄) = σ/√n; z = (x̄ − μ)/(σ/√n)
Standard error of a proportion
σ(p̂) = √[p(1−p)/n]
Confidence Intervals and Sample Size
Mean, σ known
x̄ ± z(α/2)·σ/√n
Mean, σ unknown
x̄ ± t(α/2, n−1)·s/√n
Proportion
p̂ ± z(α/2)·√[p̂(1−p̂)/n]
Sample size (mean / proportion)
n = (zσ/E)² n = p̂(1−p̂)(z/E)²
Common critical z values
90%: 1.645 95%: 1.96 99%: 2.576
Hypothesis Tests
One mean
z = (x̄ − μ₀)/(σ/√n) or t = (x̄ − μ₀)/(s/√n), df = n−1
One proportion
z = (p̂ − p₀)/√[p₀(1−p₀)/n]
Two means (pooled)
sp² = [(n₁−1)s₁² + (n₂−1)s₂²]/(n₁+n₂−2); t = (x̄₁−x̄₂)/[sp√(1/n₁+1/n₂)]
Paired data
t = d̄/(s_d/√n), df = n−1
Two proportions
z = (p̂₁−p̂₂)/√[p̄(1−p̄)(1/n₁+1/n₂)], p̄ = (x₁+x₂)/(n₁+n₂)
Regression, Chi-Square, ANOVA
Sums of squares
Sxx = Σx²−(Σx)²/n; Syy = Σy²−(Σy)²/n; Sxy = Σxy−(Σx)(Σy)/n
This study companion is designed to conform to WCAG 2.1 Level AA. Features include:
Full keyboard operation: every control is reachable with Tab and activated with Enter or Space, with a visible focus indicator throughout.
A skip link to bypass navigation, plus proper landmarks (header, navigation, main) and a logical heading hierarchy on every page.
Screen-reader support: expandable solutions and answers use aria-expanded, chapter changes and progress updates are announced through a polite live region, and the current chapter is marked with aria-current.
Text sizing controls (A / A+ / A++) in the header; all text is set in relative units and the layout reflows to 320 px wide without loss of content.
Color contrast of at least 4.5:1 for text, and no information conveyed by color alone — completion is shown with a check mark and announced text, not just color.
Reduced-motion preference respected: all animation is disabled when the operating system requests it.
Printing the page prints all solutions and answers expanded.
If any barrier is found, please report it to the publisher so it can be fixed.