This paper provides an algorithm for computing Markov Perfect Nash Equilibria (Maskin and Tirole, 1988a and b) for dynamic models that allow for heterogeneity among firms and idiosyncratic (or firm specific) sources of uncertainty. It has two purposes. To illustrate the ability of such models to reproduce important aspects of reality, and to provide a tool which, given appropriate parameter estimates, can be used for both descriptive and policy analysis in a setting which allows firms to differ from one another in ways that are consistent with the information in firm level data sets.
We illustrate by computing the policy functions, and simulating the industry structures, generated by a class of dynamic differentiated product models in which the idiosyncratic uncertainty is due to both the random outcomes of each firm's research process, and to an autonomous aggregate demand process. The illustration focuses on comparing the effect of different regulatory and behavioral assumptions on market structure and on welfare for one particular set of parameter values. The results here are of some independent interest and can be read without delving into the technical detail of the computational algorithm.
The last part of the paper begins with an explicit consideration of the computational burden of the algorithm, and then introduces approximation techniques designed to make computation easier. The purpose of this section is to enable us to compute equilibria for industries in which a large number of firms are typically active. Its major result is analytic. We show that if the value function of a given firm is exchangeable in the state vectors of its competitors, then the number of polynomial coefficients one needs for a given order of a polynomial approximation to that function is both independent of the number of firms active in the market, and a relatively small number. This enables us to use the approximation technique to reduce the computational burden of the algorithm dramatically.