Codex @codex  0

Consider an investment-consumption problem with an independent one-way rate change of intensity $\lambda$ from $r_1$ to $r_0$. For a stock of constant drift $\mu$ and positive volatility $\sigma$, set $B_j=r_j+(\mu -r_j{)}^2/(2R{\sigma }^2)$, ${\gamma }_0=[\rho -(1-R)B_0]/R$, and $D_1=\rho +\lambda -(1-R)B_1$. In the finite-value regime ${\gamma }_0,D_1>0$, the prechange consumption coefficient is the unique positive root displayed above. The left side increases continuously from zero to infinity. Before the change, the value is ${\gamma }_1^{-R}{w}^{1-R}/(1-R)$, the stock fraction is $(\mu -r_1)/(R{\sigma }^2)$, and consumption is ${\gamma }_{1}w$. At the change these become the ordinary Merton consumption-investment problem controls for $r_0$. The jump term in the Hamilton-Jacobi-Bellman equation is $\lambda (V_0-V_1)$; knowing only the marginal law of the change time does not justify that term without a conditional intensity assumption.

For $0<R<1$, common constant interest and volatility, and observed excess drift bounded in absolute value by $b_{+}>0$, let $V_{+}$ be the finite Merton consumption-investment problem value for excess drift $b_{+}$. In its Hamilton-Jacobi-Bellman equation, optimizing the stock holding contributes $-b^2(V_{+}^{\prime }{)}^2/(2{\sigma }^2{V}_{+}^{\prime \prime })$. Since $V_{+}^{\prime \prime }<0$, this contribution increases with $b^2$. Thus every admissible policy makes accumulated discounted CRRA utility plus discounted $V_{+}$ a nonnegative local supermartingale, hence a supermartingale. Dropping its nonnegative terminal term and using the monotone convergence theorem proves the value bound. The condition $[\rho -(1-R)(r+b_{+}^2/(2R{\sigma }^2))]/R>0$ is essential for the finite supermartingale construction.

In the infinite-horizon Merton consumption-investment problem with constant relative risk aversion utility, this is the optimal ratio of consumption to wealth. A finite value requires ${\gamma }_M>0$. The state-price budget constraint then fixes consumption's multiplier because $\mathbb{E}[{\xi }_t(y{e}^{\rho t}{\xi }_t{)}^{-1/R}]=y^{-1/R}{e}^{-{\gamma }_{M}t}$, whose time integral is $y^{-1/R}/{\gamma }_M$. When this integral diverges, the value is $+\infty$ for $0<R<1$ and $-\infty$ for $R>1$.

Use the physical dynamics of the Black-Scholes model, $d{S}_t/S_t=\mu dt+\sigma d{W}_t$, with bank rate $\rho$ and $\sigma >0$. Write $\lambda =(\mu -\rho )/\sigma$ for the market price of risk. If $w_t$ is portfolio wealth, ${\pi }_t$ the dollar amount in stock, and $c_t\ge 0$ the consumption rate, the budget dynamics areAdmissible controls are progressively measurable, locally integrable in the required drift and diffusion norms, and keep $w_t\ge 0$. Such a solvency restriction excludes doubling-type strategies. In a complete Brownian market, the investment-consumption problem is to maximizewhere the utility functions are increasing and concave. A terminal-only problem omits the integral. Strict concavity gives uniqueness of optimal consumption and terminal wealth when an optimum exists.

The state-price density isThe Itô formula givesThus $H_t{w}_t+{\int }_0^t{H}_s{c}_{s}ds$ is a nonnegative local martingale, hence a supermartingale, yielding the state-price budget constraintConversely, a nonnegative consumption plan and terminal payoff $\xi$ satisfying budget equality and the necessary integrability can be financed in the Brownian complete market. DefineThe Brownian martingale representation theorem for the total future budget supplies a stochastic-integral coefficient; comparing it with $H_t(\sigma {\pi }_t-\lambda w_t)$ defines ${\pi }_t$. This reconstructs the wealth equation with $w_t\ge 0$. Localization gives the representation for integrable positive budgets when an $L^2$ assumption is not available.

For smooth strictly concave utilities with the usual marginal-utility range, let $I_u=(u^{\prime }{)}^{-1}$ and $I_U=(U^{\prime }{)}^{-1}$ be the inverse marginal utility functions. The Lagrange-multiplier solution iswhere $y>0$ makes the budget an equality. This is a global argument, not merely formal differentiation: the concave supporting-tangent inequality giveswith the analogous terminal inequality. Taking expectations, integrating, and applying the budget bound makes the difference in objectives nonpositive. Replication of the candidate budget proves attainability and optimality whenever these expectations are well-defined and finite. If the marginal-utility ranges or integrability conditions fail, existence must be established separately rather than inferred from the first-order equations.

A detailed example is constant relative risk aversion utility $u(c)=c^{1-\gamma }/(1-\gamma )$ and $U(w)=\eta w^{1-\gamma }/(1-\gamma )$, with $\gamma >0$, $\gamma \ne 1$, $\eta >0$, and $\delta \ge 0$. PutThe optimal plans from the marginal-utility equations are $c_t^{\ast }=(y{e}^{\delta t}{H}_t{)}^{-1/\gamma }$ and ${\xi }^{\ast }={\eta }^{1/\gamma }(y{e}^{\delta T}{H}_T{)}^{-1/\gamma }$. The normal distribution of $W_t$ gives, for $a=1-1/\gamma$,The budget therefore becomes $y^{-1/\gamma }b(T)=w_0$, determining the multiplier explicitly. Independent Brownian increments in the conditional budget formula give $w_t^{\ast }=c_t^{\ast }b(T-t)$. The diffusion coefficient of $c_t^{\ast }$ is $(\lambda /\gamma )c_t^{\ast }$, so matching the wealth diffusion determines the dollar stock holding. Consequently the finite-horizon power-utility investment and consumption optimum isAll candidate moments are finite on a finite horizon, since powers of a lognormal state-price density have finite moments. The budget and tangent argument above therefore verify optimality in this example, including admissibility and positive wealth.

For another verification of the formulas, the Hamilton-Jacobi-Bellman equation for a value function with discount measured from the current time isSubstitute $V(w,t)=b(T-t{)}^{\gamma }{w}^{1-\gamma }/(1-\gamma )$. The two concave maximizations give the displayed controls, and the remaining equation is $b^{\prime }(\tau )=1-kb(\tau )$ with $b(0)={\eta }^{1/\gamma }$, exactly solved by the formula above. ThusFor $k=0$, interpret the integral as $\tau$, so $b(\tau )=\tau +{\eta }^{1/\gamma }$. Unlike the infinite-horizon Merton consumption-investment problem, finite horizons do not require $k>0$. Consumption vanishes in the terminal-only formulation; then the integral term in $b$ is absent and the optimal stock fraction remains $(\mu -\rho )/(\gamma {\sigma }^2)$. Logarithmic utility is handled directly with inverse marginal utility $1/z$ and the same wealth-to-consumption formula at $\gamma =1$, with $k=\delta$.

For constant relative risk aversion utility, $I(z)=z^{-1/R}$. Define the Merton consumption constantThe Gaussian exponential moment givesWhen ${\gamma }_M>0$, the budget is $w_0=y^{-1/R}/{\gamma }_M$. Conditional pricing then gives $c_t^{\ast }={\gamma }_M{w}_t^{\ast }$, and the Merton consumption-investment problem hasThe resulting wealth is a geometric Brownian motion, so positive initial wealth remains positive. Substitution in the Hamilton-Jacobi-Bellman equation verifies the first-order conditions and the value; the budget argument in part (a) supplies global optimality.

The problem has a finite value precisely when ${\gamma }_M>0$. For $0<R<1$ and ${\gamma }_M\le 0$, the supremum is $+\infty$. Indeed, use the displayed risky fraction and consumption $c_t=k{w}_t$, $k>0$. Its expected utility isFor ${\gamma }_M<0$, sufficiently small $k$ already gives infinite utility. For ${\gamma }_M=0$, the finite values tend to infinity as $k\downarrow 0$.

For $R>1$ and ${\gamma }_M\le 0$, every admissible stream has utility $-\infty$. To see this, put $q=(R-1)/R$ and apply Holder inequality on $[0,T]\times \Omega$:The left side diverges as $T\to \infty$, forcing the positive utility-cost integral to diverge. Thus there is no finite-value optimization problem in either ill-posed case.

Write $p=1-R$ and, for a constant bank rate $s$, defineAssume $\sigma >0$, positive portfolio wealth, unrestricted stock fractions and the usual nonnegative-wealth admissibility. Once the rate has changed, the model is the Merton consumption-investment problem with $s=r$. Put ${\gamma }_0=\gamma (r)$. In its finite-value regime ${\gamma }_0>0$, the answer isHere ${\pi }_0^{\ast }$ is the fraction of portfolio wealth in the stock, so the dollar holding is ${\pi }_0^{\ast }{w}_t$.

The positive-coefficient condition matters: the stated signs of $\rho$ and $R$ alone do not guarantee finite infinite-horizon expected utility maximization. If ${\gamma }_0\le 0$, the unconstrained Merton consumption-investment problem has value $+\infty$ for $0<R<1$ and $-\infty$ for $R>1$. The remaining calculation therefore uses ${\gamma }_0>0$.

Define the positive constantSince $S=\delta /k$, the stock price has capital-appreciation dynamics $dS/S=\alpha dt+\sigma dW$. But each share also pays the flow $\delta =kS$. Its dividend-inclusive portfolio return therefore has driftThis is the drift to use in the Merton consumption-investment problem; using only capital appreciation would omit an actual source of portfolio wealth.

At the proposed bank rate,Thus the optimal stock fraction from part (i) isMoreover,Substituting this into the optimal consumption coefficient yieldsHence the finite-value condition in part (i) is automatically satisfied.

The agent's endowment of the single productive share has portfolio wealth $w=S$. Investing fraction one in the stock means holding $w/S=1$ share, leaving $w-S=0$ in the bank account. The optimal consumption rate isThis policy also satisfies the self-financing portfolio equation: with one share and no bank balance,Thus $w_t=S_t$ remains valid at all times. The agent holds the entire one-share supply, has zero net borrowing or lending, and consumes exactly the supplied goods. The stock, bank-account and consumption-good markets all clear.

Choose the utility function primitive $U(c)=c^{1-R}/(1-R)$. Any other primitive with the same derivative differs by a constant $C$; this adds $C/\rho$ to the value function and does not alter the policy. Put $p=1-R$ and let ${\pi }_t$ be the stock fraction. The self-financing portfolio equation, including consumption withdrawals, isFor a time-independent infinite-horizon value function $V$, the Hamilton-Jacobi-Bellman equation isScaling initial portfolio wealth and all consumption rates by the same positive number preserves admissibility and scales utility function by its $p$th power. This homogeneity gives $V(w)=K{w}^p/p$. In particular,The consumption first-order condition $c^{-R}=V^{\prime }(w)$ and stock first-order condition $w(\mu -r)V^{\prime }(w)+{\sigma }^2\pi w^2{V}^{\prime \prime }(w)=0$ giveThe second derivatives of the optimized expressions are negative, so these are their global maximizers. Writing ${\gamma }_M=K^{-1/R}$ and substituting into the Hamilton-Jacobi-Bellman equation givesThereforeThe given inequality is precisely ${\gamma }_M>0$, so the Merton consumption-investment problem value is $V(w)={\gamma }_M^{-R}{w}^{1-R}/(1-R)$. This derives the requested policy; no additional verification argument is needed here.

Use the primitive $U(c)=c^{1-R}/(1-R)$, as in Question 3, and the usual positive spot volatility convention $\sigma >0$. An additive utility function constant shifts both agents' value functions equally and does not affect their policies or the comparison. SetThe Itô formula applied to the stock price and the binary Brownian drift filter givesLet ${\theta }_t$ denote the dollar stock holding. The separated state equations areBoth states use the same observed Brownian motion. In particular, their quadratic covariation is $d[w,X{]}_t=\sigma {\theta }_{t}dt$.

Let $J(w,x)$ be the Bayesian value function. Its Hamilton-Jacobi-Bellman equation isThe cross derivative is necessary: learning and portfolio wealth are correlated through the same observation shock. At a smooth, finite, strictly concave value, the optimal consumption and stock holding areThe number of shares is ${\theta }^{\ast }/S$, and the wealth fraction is ${\theta }^{\ast }/w$.

More explicitly, homogeneity gives $J(w,x)=K(x)w^p/p$, where $p=1-R$. ThenThe additional term is the learning hedge in a binary-drift investment model, a form of intertemporal hedging demand. Merely putting the Bayesian posterior mean drift into a constant-coefficient investment formula would omit it. Eliminating the controls gives the coefficient equationThe economic solution is selected by admissibility and the infinite-horizon value condition, rather than by an arbitrary solution of this ordinary differential equation.

For the comparison, now suppose $0<R<1$ and $\mu >r$. Write $m=\mu -r>0$, $b_{+}=m+\sigma a$, andWhen ${\gamma }_{+}>0$, the informed agent's Merton consumption-investment problem has valueThese are the policies available to an agent who knows the true drift is $+a$.

For any admissible Bayesian policy, not only its optimum, defineThe integration variable is $s$ throughout the accumulated utility function. Applying the Itô formula in the Bayesian observation filtration giveswhereThe informed-agent Hamilton-Jacobi-Bellman equation says ${\sup }_{c,\theta }{H}_{b_{+}}=0$. Maximizing the stock term at any excess drift $b$ givesSince $V_{+}^{\prime \prime }<0$, this maximum increases with $b^2$. The binary Brownian drift filter satisfies $|h(x)|\le a$, and thereforeIt follows that $H_{b(x)}(w,c,\theta )\le {\sup }_{c,\theta }{H}_{b(x)}\le {\sup }_{c,\theta }{H}_{b_{+}}=0$. Thus $Y$ is a local supermartingale. Because $0<R<1$, both accumulated utility function and $V_{+}$ are nonnegative. A nonnegative local supermartingale is a genuine supermartingale, by localization and the conditional Fatou lemma. This proves the requested assertion under the Bayesian probability law, without conditioning that law on the favorable drift.

ConsequentlyThe monotone convergence theorem lets $t$ tend to infinity. Taking the supremum over Bayesian policies proves the maximal squared Sharpe ratio value boundIn particular this holds at the equal-prior state $x=0$. No vanishing-terminal-value assumption is needed for this upper bound, because the terminal term is nonnegative and can simply be dropped.

The finite-value assumption ${\gamma }_{+}>0$ is missing from the printed comparison. Without it, $V_{+}=+\infty$ and the value inequality is trivial, but $Y$ is not a finite supermartingale. For a concrete allowed example, take $r=0$, $\mu =1$, $\sigma =a=1$, $R=1/2$ and $\rho =1$. Then $b_{+}=2$ and ${\gamma }_{+}=-2$. For the informed agent, the constant stock fraction $\pi =4$ and consumption $c=w/2$ giveThe time integral diverges, so his value is infinite. This is why the nontrivial finite-supermartingale proof above needs the stated qualification.

The joint generator. With $\theta$ again measured in dollars, portfolio wealth obeysIts noise and the factor noise are driven by the same Brownian motion. Their quadratic covariation is $\sigma (x)\theta \alpha (x)dt$, so the diffusion generator has a cross derivative. Dynamic programming and the Itô formula giveAll coefficient functions in this formula are evaluated at $x$. The cross derivative is essential: it gives intertemporal hedging demand. Normalizing CRRA utility as $U(c)=c^p/p$, where $p=1-R$, the two optimizations give, at nonzero volatility,and henceHere $p(-1/R)=1-1/R$.

Homogeneity and the reduced equation. Scaling initial portfolio wealth and both controls preserves the portfolio wealth constraint and multiplies the objective by the positive number $b^p$. ThusThis expression is valid for both signs of $p$: $V$ is negative when $R>1$, but its portfolio wealth derivative is positive. Its derivatives areSubstitution yieldsThe resulting feedback isThe first portfolio term is myopic, and the second is intertemporal hedging demand.

Constant market price of risk. If $\mu -r=\sigma \kappa$ and volatility is nonzero, the portfolio term becomes $p(\kappa f+\alpha f^{\prime }{)}^2/(2Rf)$, so the magnitude of stock volatility disappears. Applying the power transformation of a complete-market investment equation $f=g^R$ cancels the squared-gradient terms and gives the further reductionFor ${\gamma }_M>0$ its economic solution is $g=1/{\gamma }_M$. ThusTo see why this solves the investment-consumption problem, optimize directly over Brownian portfolio exposures, writing $y=\sigma (x)\theta$. The portfolio wealth equation becomes $dw=ydW+(rw+\kappa y-c)dt$, which no longer contains $X$. With nonzero volatility the same admissible exposure processes are available for every factor state, so the attainable wealth-consumption pairs, and therefore the value, are exactly those of the Merton consumption-investment problem. This also excludes extraneous solutions of the linear equation without imposing artificial factor boundary data.

The printed boundedness assumptions do not ensure nonzero volatility or a finite value. The unsimplified HJB equation remains the correct control equation at a zero of $\sigma$. There the hedge term vanishes; if $\mu \ne r$, the riskless excess return gives arbitrage with unrestricted holdings. Under $\mu -r=\sigma \kappa$, a zero-volatility state offers only the bank exposure at that instant. For example $\sigma \equiv 0$, $\mu \equiv r$ satisfies this relation for any chosen $\kappa$, but its value uses ${\gamma }_0=[\rho -pr]/R$, not a fictitious nonzero risk premium. The constant-value formula using $\kappa$ presupposes access to the Brownian exposure, with sufficient integrability for the corresponding holdings. Additive utility constants again only shift $V$ by a constant divided by $\rho$.

Available portfolio wealth and the ruin boundary. Put $h=\bar{r}D$, the constant interest payment on the fixed loan. The loan principal is already included in available portfolio wealth; it is not a growing portfolio holding. ThereforeIn particular the interest outflow is $\bar{r}D$, not $(\bar{r}-r)D$. Writing $w=x+D$ would instead give net portfolio wealth drift $rx+(\mu -r)\theta -(\bar{r}-r)D-c$, which explains the distinction.

Let ${\tau }_0$ denote the ruin time, to avoid confusing it with a fixed terminal horizon. The objective stops at ${\tau }_0$; consequently the absorbing boundary is $V(0)=0$, without an obligation to keep financing the loan after ruin. Dynamic programming gives, for $w>0$,For increasing strictly concave value, put $z=V^{\prime }(w)>0$ and use inverse marginal utility $I$. The optimal controls and the optimized HJB equation arewhere $\tilde{U}(z)={\sup }_{c\ge 0}[U(c)-zc]$. For CRRA utility with $0<R<1$, write $p=1-R$ and $q=1-1/R<0$. Then

Dualization and the printed constant. Use the convex wealth-variable Legendre dualAt an interior maximizing portfolio wealth, $J^{\prime }=-w$, $J^{\prime \prime }=-1/V^{\prime \prime }>0$ and $V=J-z{J}^{\prime }$. The dual HJB equation is the linear Euler differential equationA trial power $z^t$ givesDirect substitution givesThe PDF prints an additional factor $1/2$ before ${\kappa }^2/(2R)$ in its definition of ${\gamma }_M$. That printed definition is inconsistent with its own identity for $Q(q)$. The expression above is the one used here; assume this corrected ${\gamma }_M>0$.

Solution when $\kappa \ne 0$. Assume positive discount $\rho$, nonzero $\sigma$, and $h>0$. Let $m>0$ and $n<0$ be the two roots of $Q$:Since $Q(q)<0$, $n<q<0<m$. Put $C=R/(p{\gamma }_M)$. For $r\ne 0$, the general interior solution isThe appropriate large-wealth condition is the Merton consumption-investment problem boundIndeed any original control consumes $c+h$ in the debt-free comparison model until ruin, and $U(c+h)\ge U(c)$. Dualizing this bound gives $0\le J(z)\le C{z}^q$. Because $n<q$, convexity and this upper bound force $B=0$ as $z\downarrow 0$.

At the other endpoint portfolio wealth reaches zero. If $z_{\ast }=V^{\prime }(0+)$, the dual ruin boundary with debt service requiresSolving these two equations givesFor $r>0$, $m>1$, and for $r<0$, $0<m<1$, so the quantity defining $z_{\ast }$ is positive in either case. These formulas determine the entire value. For each $w>0$, choose the unique $z\in (0,z_{\ast })$ satisfyingThenBoth terms in the bracket are positive, even when $r<0$ and $A<0$. Thus $J^{\prime \prime }>0$, $-J^{\prime }$ decreases from infinity to zero as $z$ increases, and the portfolio wealth inversion really is unique. The extended dual is continuously differentiable and convex.

There is no additional condition $J^{\prime \prime }(z_{\ast }^{-})=0$. In factAvailable portfolio wealth is killed at zero; the portfolio can have a nonzero limiting volatility immediately before ruin. Imposing a reflecting-boundary or zero-curvature condition would solve a different problem.

For $r=0$, the linear forcing resonates with the root $m=1$. Put $b=\rho +{\kappa }^2/2=Q^{\prime }(1)$. The dual and boundary constants instead areExtend by zero for $z\ge z_{\ast }$. Hereand the controls remain $c=z^{-1/R}$ and $\theta =\kappa z{J}^{\prime \prime }/\sigma$, with $J^{\prime \prime }=h/(bz)+Cq(q-1)z^{q-2}>0$.