PSet1 CS725 2022
PSet1 CS725 2022
Problem 1. Conditional probabilities. The recommended textbook for CS 725 is in the main li-
brary in one of several shelves. It is known a priori that the book is in shelf i with probability pi < 1.
However, all the books are so chaotically ordered that even if someone correctly guesses that the book
is in shelf i, the probability of finding it there is only qi . A student searches for the book in a particular
shelf, say shelf i, and does not find the book. Conditioned on this event, what is the probability that
the book is in a shelf j? Consider both cases j = i and j 6= i.
Problem 2. Simple expectation. R has a keen interest in gambling. Recently, he met an agent S
who invited him to a gambling event. Here, a player has to pay a sum of 2i−1 dollars in the ith round.
The player is awarded 2i dollars if he/she wins that round. A person wins a round if he/she lands on
a head on tossing a 2-sided fair coin. R has the following two queries for which he solicits your help.
1. Suppose he keeps playing even if he loses the rounds. Will he ever make any profit?
Problem 3. Probability mass function Consider n Bernoulli trials where i-th trial has success prob-
ability pi . For any i, j ∈ [1, n] such that i 6= j, pi 6= pj . What is the probability of getting exactly k
successes in n trials? What is the probability of at most k successes? [Hint: Use power sets.]
Problem 4. Expectations. Given an array of integers A, a triple of indices i, j, k such that i < j < k
is said to be sorted if A[i] < A[j] < A[k]. What is the expected number of sorted triples in an array
populated with integers 1 to N in random order? [Hint: Use linearity of expectation.]
1
Problem 6. Vectors and Norms If kvk = 5 and kwk = 3, what are the smallest and largest values of
kv − wk ? What are the smallest and largest values of v . w?
Problem 7. Null/column spaces. Let A ∈ R7×9 and Ax = b has a solution for every b. What can
you say about the column space and null space of A? What is the rank of A?
Problem 8. True or False? True or False. For the following statements, choose an appropriate
answer and justify briefly.
4. Say you have an m × m matrix A that is invertible. Then, the columns of A form a basis for
Rm .