A survey of dynamic microsimulation models: Uses, model structure and methodology
- Article
- Figures and data
-
Jump to
- Abstract
- 1. Introduction
- 2. Overview of models and their uses
- 3. Model types, structure and datasets
- 4. Estimations and validations of microsimulation models
- 5. Programming of dynamic micro-simulation models
- 6. Progress in dynamic micro-simulation
- 7. Future directions
- 8. Conclusions
- References
- Article and author information
Abstract
More than 10 years ago O’Donoghue (2001a) surveyed the dynamic microsimulation models that had been developed up to that point. However many of the barriers mentioned have been gradually overcome in the last decade. This paper surveys the development and practices in dynamic microsimulation over the past decade, and discusses the methodological challenges today. It provides an overview of the methodological choices made in more than 60 known dynamic microsimulation models and examines the advantages and disadvantages of different practices. In addition, this paper reviews the main progress made in the field and explores how future microsimulation models could evolve potentially.
1. Introduction
A dynamic microsimulation model is a model that simulates the behaviour of micro-units over time. Orcutt et al. (1961) described the first dynamic microsimulation model following the inspiration of Orcutt’s (1957) article. Most dynamic microsimulation models that have developed in following decades trace a direct or indirect link back to this model. Urban planners use microsimulation techniques to estimate traffic flows, while in the field of economics and social science, microsimulation is often used to analyse the social economic policies. In this paper we shall review how dynamic microsimulation in social science has developed, with main focuses on the economic models developed in the past decade.
Micro level data, such as data obtained from a household survey, is often chosen as the basis for social economic research. In order to evaluate certain impacts of public policies, e.g. the redistributive impact over the course of a lifetime, it is necessary to utilise a long panel dataset. In general, such datasets are not available, either because the analysis relates to the future, as in the case of pension forecasts, or because collected datasets do not cover sufficiently long time periods; therefore, analysts use dynamic microsimulation models to assist in their analysis, a concept which was initially suggested by Orcutt in 1957. Essentially, microsimulation is a tool to generate synthetic micro-unit based data, which can then be used to answer many “what-if” questions that, otherwise, cannot be answered.
Microsimulation models, as in the field of policy modelling, are usually categorised as “static” or “dynamic.” Static models, e.g. EUROMOD (Sutherland, 2007), are often used to evaluate the immediate distributional impact upon individuals/households of possible policy changes without reference to the time dimension and extensive behavioural adjustment. Some newer static models, e.g. IZAΨMOD (Peichl et al., 2010), improved the traditional model by incorporating certain behaviour responses assuming the market adjusts to the new steady state overnight. Dynamic models, e.g. DESTINIE, PENSIM, and SESIM (Bardaji et al., 2003; Curry, 1996; Flood, 2007), extend the static model by allowing individuals to change their characteristics due to endogenous factors within the model (O’Donoghue, 2001a) and let individual units to progress over time. Because of the integrated long-term projections and time dependent behaviour simulations, dynamic microsimulation models could offer further insights in theory.
10 years ago O’Donoghue (2001a) surveyed the dynamic microsimulation models that had been developed up to that point. However, many of the barriers that existed for model development back in 2001 have been overcome. Data collection projects such as the European Community Household Panel and the increased availability of longitudinal administrative data such as the Lifetime Labour Market Database in the UK have loosened the data constraints. A number of new models were developed in the past decade, for instance Pensim2 (Emmerson et al., 2004), IFS Model (Brewer et al., 2007) and SAGE (Zaidi & Rake, 2001) models in UK, APPSIM in Australia (Harding, 2007a) and DESTINIE2 (Blanchet et al., 2009) in France etc. Meanwhile, a few generic software programmes have emerged, such as ModGen (Wolfson & Rowe, 1998), UMDBS (Sauerbier, 2002), GENESIS (Edwards, 2004) and LIAM (O’Donoghue et al., 2009), eliminating the need to create a model from scratch. It has allowed an internationalisation of the models with developments in Belgium (Dekkers & Belloni, 2009), Italy (Dekkers et al., 2010), Canada (Spielauer, 2009), UK (Emmerson et al., 2004) etc. Nevertheless, the decade has seen the demise of a number of models such as DYNACAN in Canada, CORSIM in U.S., NEDYMAS (Dekkers et al., 1993) in the Netherlands, the Belgian model (Joyeux et al., 1996) and MIDAS in New Zealand etc. The micro-econometric and micro-economic understandings of the processes that make up a dynamic microsimulation model have also greatly improved over this period. It is therefore worth in considering the progress made by the discipline over the past decade.
In this paper we shall describe the models developed, their uses and discuss some of the methodological choices faced. We then review the progress made by the discipline since the earliest models and suggest some directions for future development.
2. Overview of models and their uses
Dynamic microsimulation models can have many uses and this section provides an overview of the principle uses. Table 1 summarises many of the existing dynamic microsimulation models in terms of their main purposes, which covers projection, evaluating/designing public policies, inter-temporal behaviour studies, etc. Given that the most accessible micro datasets for social scientists are household or individual level information, most models do not incorporate information on business establishments, with a few exceptions for models like (Sweden) MOSES (Eliasson, 1977), NEDYMAS model, where business behaviours are incorporated through market equilibriums in the models. There are only a small number of firm-level microsimulation models, e.g. DIECOFIS (Parisi, 2003), and they are mostly static.
Following the introduction of the time dimension into dynamic microsimulation, these models are able to provide useful projections for the trend of socio-economic development under current policies. DYNASIM2/3 (Wertheimer et al., 1986; Favreault & Smith, 2004), APPSIM (Harding, 2007a), the SfB3 population model (Galler & Wagner, 1986), DYNAMITE (Ando et al., 2000), SADNAP (Van Sonsbeek, 2010) and DESTINIE1/2 (Bonnet & Mahieu, 2000; Blanchet et al., 2009), have all been used for these purposes. In some cases, dynamic microsimulation models have been used as an input for macro models such as in the case of the MOSART (Andreassen et al., 1994; Fredriksen, 1998, 2003), DYNASIM2 and DARMSTADT (Heike et al., 1987) models.
Dynamic microsimulation models can also be used to evaluate the future performance of various long-term programmes such as pensions, educational financing, and health and long-term care, by analysing simulated future cross-sectional data. The governmental models such as DYNCAN (Morrison, 2000), POLISIM (McKay, 2003), PENSIM2 (Emmerson, 2004), the Sfb3 models (Galler & Wagner, 1986), MOSART (Andreassen et al., 1996), PENMOD (Shiraishi, 2008) and SESIM (Ericson, & Hussenius, 1999; Klevmarken & Lindgren, 2008) have been extensively used for this purpose. The existence of baseline projections allows the design of a new public policy by simulating the effect of potential reforms. Models such as LIAM (O’Donoghue et al., 2009), PRISM (Kennell & Sheils, 1990), the Belgian dynamic model (Joyeaux et al., 1996), the SfB3 population model (Galler & Wagner, 1986), LIFEMOD (Falkingham & Johnson, 1993), SESIM (Flood, 2007; Klevmarken, 2010) and Belgium MIDAS (Dekkers et al., 2010; Dekkers & Belloni, 2009), have all been used to look at pension reform. A number of models such as DYNAMOD, the SfB3 cohort model (Hain & Hellberger, 1986), LIFEMOD (Harding, 1993), and SAGE (Zaidi & Scott, 2001) have been used to examine changes to education finance, whereby education costs are to be paid for over an individual’s lifetime. Fölster (2001) used a microsimulation model to examine reforms to social insurance utilising personal savings accounts.
With the longitudinal information created from dynamic microsimulation models, researchers can study the inter-temporal processes and behaviours at both the aggregate and individual levels. For example, CORSIM (Keister, 2000), DYNAMOD (Baekgaard, 1998), and the New Zealand MIDAS model (Stroombergen et al., 1995) have all been used to look at wealth accumulation. Creedy and van de Ven (2001), Nelissen (1998) and others have used dynamic microsimulation models to explore lifetime earning redistributions. Models such as DESTINIE1/2, LIAM, LifePaths, and IFSIM have been used to examine intergenerational transfers (Rowe & Wolfson, 2000; Bonnet & Mahieu, 2000; Blanchet et al., 2009; Baroni et al., 2009; O’Donoghue et al., 2009), whilst FAMSIM (Lutz, 1997) has been used to study the demographic behaviour of women, and MICROHUS (Klevmarken & Olovsson, 1996) examined the impact of a tax-benefit system on labour market mobility. Models that simulate these processes can be used to design policies to combat these problems, for example DYNASIM was used to study the effect of teenage childbearing, while CORSIM has been used to look at dental health within the US population (Brown et al., 1995). The FEM and POHEM models were designed to evaluate the evolution of the population’s health status and its budget implications for the US and Canada (Zucchelli et al., 2010; Will et al., 2001), whist the LifePaths modelling framework has been used in Canada to examine time use issues (Wolfson & Rowe, 1998).
By combining spatial information with dynamic microsimulation models, the model can also be used to predict the geographical trend of certain social economic activities. This type of model is usually referred to as a dynamic spatial microsimulation model, e.g. MOSES (Wu et al., 2008) from U.K., there are a number of models that attempt to analyse policy changes at the national level. For instance, the SVERIGE model simulates a number of demographic processes for policy analysis in Sweden (Vencatasawmy et al., 1999; Holm et al., 2003), whilst the SMILE model (Ballas et al., 2005a; O’Donoghue et al., 2011) analyses the impact of policy change and economic development on rural areas in Ireland. In addition to modelling economic policy, SimBritain (Ballas et al., 2005b) looks at the evolution of health at the national level while models such as SustainCity (Morand et al., 2010) focus on the housing market with a dynamic setting.
Since dynamic microsimulation models typically project samples of the population over time, one can use the model to examine future income distributions under different economic and demographic scenarios. DYNASIM2/3 (Wertheimer et al., 1986; Favreault & Smith, 2004), APPSIM (Harding, 2007a), the SfB3 population model (Galler & Wagner, 1986), DYNAMITE (Ando et al., 2000), SESIM (Klevmarken & Lindgren, 2008), SADNAP (Van Sonsbeek, 2010) and DESTINIE1/2 (Bonnet & Mahieu, 2000; Blanchet et.al, 2009) have been used for these purposes. These models typically utilise macro-models or forecasts to align their own projections. However, occasionally the opposite has occurred, where dynamic microsimulation models have been used as input into macro models as in the case of MOSART (Andreassen and Solli, 2000), DYNASIM (Wertheimer et al., 1986; Favreault & Smith, 2004) and the DARMSTADT models.
Although Table 1 tries to cover as many known models as possible, it is nearly impossible to give a complete list as new models are being developed every year. In addition, the list focuses more on the dynamic microsimulation models that are mainly used for social economic analyses. Certain regional dynamic spatial models and transportation models are not included.
One can also track the development of models through a number of lineages. The original Orcutt Socio-economic System (Orcutt et al., 1961) led to DYNASIM described above, which in turn led to CORSIM which in turn led to POLISIM, DYNACAN and SVERIGE models. In parallel, large modelling developments in the 1970’s took place in Sweden and Germany with current antecedents, while the LSE welfare state programme of the 1980’s have spawned the LIFEMOD, PENSIM, PENSIM2 and SAGEMOD models in the UK as well as the HARDING model in Australia and LIAM model in Ireland. Subsequently the HARDIING model led within the creation of NATSEM to a range of models in Australia, while the LIAM model has influenced a number of European models including the LIAM2 modelling framework. Separately to these largely related developments, Statistics Canada has developed a series of Lifepath/MODGEN based models based upon the original DEMOGEN.
All these powerful dynamic microsimulation models come with the cost of high complexity. Compared with static microsimulation, dynamic microsimulation is much more costly to develop and also has more issues with the methodologies used. This paper intends to discuss some of the methodological issues related to the construction of a dynamic microsimulation model, surveying current practice in the field around the world.
3. Model types, structure and datasets
3.1 An overview of the technical choices made by dynamic microsimulation models
This section continues the discussion of methodological issues faced in constructing dynamic microsimulation models but focuses on the technical implementation and choices made in a model. Table 2 describes the data source and sample size used by different dynamic microsimulation models while Table 3 provides an overview of the technical choices of the modelling structure. These two tables will be discussed in details in this section.
3.2 Base dataset selection
Base dataset selection is important in a microsimulation model as the quality of the input data determines the quality of the output. However, selection of a base dataset is not an easy task as hardly any micro dataset contains all the information required by a dynamic population microsimulation model and the difficulties of picking a base dataset have been discussed by Zaidi and Scott (2001), Cassells et al. (2006), Klevmarken and Lindgren (2008) and many other papers. There are a number of different types of base data that a dynamic model can utilise. As shown in Table 2, a dynamic microsimulation model typically starts with one or several of the following types of dataset according to their sources:
Administrative Data
Census Data
Household Survey Data
Synthetic Dataset
Administrative data often contains extensive information in taxable earnings and basic (tax-related) social economic variables and the data is often collected for the most part of the population, with a much bigger sample size compared with survey data. Because the data is often collected for taxations or law enforcement purpose, the data could be very accurate for some variables, e.g. employee earnings, but very misleading in certain self-reported information, e.g. household wealth. Since the administrative data collection is a government initiative, some information that is useful for social economic researchers may not be included. For this reason, models using administrative data often seek to supplement information from external sources, such in the case of Sweden (SESIM model) where certain variables were imputed based on a survey.
Legal and privacy reasons may also prevent administrative data from being accessible. Models such as CORSIM, DYNACAN and DYNAMOD use census data. While census datasets typically have higher number of observations than household surveys, they often contain less information and have to be supplemented with imputed information from other sources.
Household survey data, e.g. the LII survey utilised in the LIAM model, are also frequently used as the base dataset because it is rich in the number of variables of interest and offers information on the dynamics of behaviour. However, household survey datasets may have the issues of smaller sample size and weights adjustment. The use of weights in a dynamic model adds complexity to many areas and can result in individuals being given different weightings at different points in their lives. As microsimulation aims at inference to a finite population, one solution, as implemented in the DYNAMITE, is to replicate household population according to their weights, so that consequently each household has the same basic weight. However, there is limited understanding on how the use of weight would affect the final outcomes of simulation models.
Another type of base dataset is synthetic data. These are selected when either a longitudinal model is used, as in the case of DEMOGEN, HARDING, LIFEMOD, LIAM (O’Donoghue, 2001a), or where no data exists, as in the case of the NEDYMAS model, where a synthetic initial sample representative of the Dutch population in 1947 was generated NEDYMAS (Dekkers et al., 1993). Synthetic datasets are artificially created with all required variables populated based on some known macro statistics and distributional assumptions. It is often used to understand theoretical implications of a single policy in depth. However, significant adjustments and justifications are required before inferring the policy effects in real life.
For microsimulation models analysing the dynamics of elderly earnings or pensions, the dataset requirement is usually higher as it requires historical variables that affect the evolution of the elderly social economic status. This necessity implies that a long panel dataset containing rich demographic, employment, and pension data is required, something which is not readily available to most researchers. Hybrid sources of datasets are often used in such scenario, whereby a combination of datasets from various sources, statistical matching and simulation techniques are utilised, for instance DYNASIM3 (Favreault & Smith, 2004) matches two survey datasets, namely, Survey of Income and Program Participation (SIPP) and Panel Study of Income Dynamics (PSID). CBOLT (Oharra et al., 2004) uses a similar approach to complement its main dataset with SIPP, PSID and data from the Current Population Survey (CPS). A recent model Tdymm (Tedeschi, 2011), intends to match administrative records with the European Union Statistics on Income and Living Conditions (EU-SILC) dataset. For researchers without access to certain required data, simulation is used to impute the longitudinal history. The CORSIM model simulates part of the historical profile based on a historical cross-sectional dataset and matches the model output to historical aggregate information such as fertility and mortality rates (Caldwell, 1996), whilst LIAM simulates a historical profile by exploiting retrospective variables, previous censuses and other data sources (Li & O’Donoghue, 2012).
Each of data matching/imputation methods has pros and cons and is often tailor-made to the specific datasets and projects. Statistical matching can be used when there are sufficient matching variables in a comparable dataset and this method has the desirable feature of having a “real-world” value, although the quality of matching may vary substantially depending on the quality and quantity of matching variables. Synthetic simulation has the advantage of flexibility but longitudinal consistency may be an issue due to the limited information available. Additionally, it is also not uncommon to estimate behavioural relations from a dataset other than the base dataset and applies the equation to simulation. In this case, however, one may want to consider the comparability and consistency issues carefully due to the survey design and variable definitions.
Another issue in the base dataset selection is sample size; the larger the sample size, the more subgroups can be considered. Sample sizes are more important for inter-temporal analysis because the number of dimensions is increased, as similar individuals in a cross-sectional sample may in fact be very different due to the different paths taken to reach the same state. Regardless the source of the dataset, panel data is usually preferred as it records changes over time. Sample size also has an impact on run time of the model; the larger the samples size, the longer the run speed, resulting in a trade-off. Faster computer power does however reduce the impact of this trade-off.
3.3 Cohort model or population model
One issue that is closely related to the base dataset selection is the type of data structure that a model uses. Harding (1993) and others have categorised inter-temporal dynamic models into two types: cohort models that model a single cohort over a relative long time period (usually lifetime), and population models that model a population cross-section over a defined period of time. In addition, some models focus only on adults (i.e. ignore children) and thus, although these models may contain a cross-section of the population, they do not represent the entire age spectrum. In many cases, only persons born within a particular year are included in the model. LIFEMOD (Falkingham & Lessof, 1992), for instance, only includes 4000 people born in 1985.
From a model design perspective, the distinction between cohort and population model is less significant than the use that the model is put to. The distinction made in the literature from a historical viewpoint has more to do with computing power and data constraints rather than any major methodological differences. Cohort models were typically used because the computing costs required to simulate whole lifetimes for cross-sections with sufficient sample sizes to be able to examine specific cohorts were too high. The method typically features less micro-units interactions as compared with a full-fledged population model. Both types of models can be simulated in the same modelling environment: a cohort model is simply a model that ages a sample of individuals in a particular age group, while a population model ages a sample of individuals of different ages. Both samples are then passed through ageing procedures, to produce life event histories over the modelled period.
It is also possible to model both types using the same computing platform. The potentially larger size of the cohort modelled in dynamic cohort models allows life time income patterns for smaller population groups such as recipients of disability benefits or lone parents to be studied. Some cross-section models such as MOSART combine both types of modelling technique as they may use a very large dataset. With increasing computation and modelling capacities, newer models tend to use population models as one may get more information and draw inference to the population directly.
3.4 Ageing method in dynamic microsimulation
Aging within a microsimulation context may be defined as the process of updating a database to represent current conditions or of projecting a database for one or more years to represent expected future conditions. There are two types of ageing processes; static ageing and dynamic ageing. Static ageing, as described in Immervoll et al. (2005), is a method that attempts to align the available micro-data with other known future information (such as changes in population aggregates, age distributions or unemployment rates), without modelling the processes that drive these changes (e.g., migration, fertility, or economic downturn). For example, in order to simulate an ageing society, the weighting of young people gradually decreases over time while the weighting of elderly people would increase; however, there is no change to the attributes of these individuals. Dynamic ageing by contrast, changes the attributes of the individuals instead of altering their weights. In the same example of simulating an ageing society, models with dynamic ageing will update the age and other related attributes of individuals over time instead of changing their weights. The method can be referred as cross-sectional dynamic ageing if all individuals are updated before a model moves on to the next time period in a dynamic ageing process, or longitudinal dynamic ageing if a model simulates all time periods for one individual before repeating the same process for the next one in the population. Dynamic ageing is generally more popular and may sometimes be used as the criteria to judge whether a model belongs to the camp of dynamic microsimulation models1.
While static ageing can ideally produce the same population representative cross-sectionals as models with dynamic ageing, it works in a very different way as it does not update social economic variables for each time period. In many cases, the only variable that needs to be changed over time is the weight of the observations. Dekkers and Van Camp (2011) noted that this might be attractive for modellers who already have a static microsimulation model, however, static ageing also has a number of disadvantages. Klevmarken (1997) highlighted that whereas static ageing may avoid some problems of drift in the projected cross-section associated with dynamic ageing because of misspecification in dynamic equations, it cannot account for mobility between states. In addition, he pointed out that from a statistical point of view, it is inefficient not to use all available historical information to project into the future. A consequence of not modelling the mobility of individuals between points in time is that it reduces the type of analyses that can be undertaken by a microsimulation model, for example, it is not possible to conduct analyses that require life event histories such as the simulation of pensions. Furthermore, future weights need to be forecast in order to age a dataset. Although macro models or other forecasting devices can be used they may not forecast weights at the level of detail required. Besides, the weight calculation may be further complicated when multiple variables are being considered at the same time2. Generally speaking, static ageing cannot be used where no sample observation is in the particular state of interest. If a particular state is under-represented, a very high weight may have to be applied to the corresponding observations, resulting in unstable predictions. As a result, static ageing procedures are mostly used in short to medium term forecasts of approximately 3–5 years, where it can be expected that large changes would not occurred in the underlying population. However, it may be more difficult to use static ageing over longer periods of time due to changing characteristics of the population.
Dynamic ageing aims to reflect the ageing process in real life though it could make a model very complicated and computational expensive. Cross-sectional dynamic ageing is the most common method while longitudinal ageing is sometimes used in cohort models. Dynamic ageing can consistently estimate characteristics of future income distributions under ideal circumstances in which all transition probabilities and state specific expectations can be estimated consistently. This may be possible in a simple model with a small number of processes, but in a fully dynamic model of work and life histories, many more processes need to be jointly estimated, a formidable requirement given the available data. Therefore, it might be necessary to make some assumptions to make estimation feasible, e.g. education choice happens before labour participation choice etc. In addition, one may also need to assume independent error terms and some other arbitrary assumptions in order to simplify the estimation. Although these assumptions are common in practice, they may lead to theoretical pitfalls and biased results when excessively used without proper testing. In addition, projections over time at the micro-level are particularly susceptible to misspecification error as modelling at this level involves more detail than in macro models, also current knowledge regarding micro-behaviour is not good enough to specify a fully dynamic model. As a result, dynamic ageing combined with an alignment (calibration) mechanism to keep aggregate outputs in line with predictions from macro models is commonly used. The method allows individual transitions to be simulated as well as ensuring that aggregate outputs on track with macro forecasts (see, for examples, Chénard 2000, 2001).
3.5 Discrete or continuous time modelling
Another choice in the development of dynamic microsimulation models is the treatment of time. Discrete time models simulate which individuals experience particular events in given time intervals while continuous time models treat time as a continuous variable and determine the exact time that an event occurs (Willekens, 2006).
Discrete time microsimulation models changes once per time period. Take demography for example, demographic modules in dynamic models are often constructed using annual transition probability matrices. Individuals are passed through a collection of transition matrices in each time period of the simulation (usually a year) to determine their simulated life paths, e.g. death. This method often assumes a sequential order of life events, however in reality they may be interdependent. As in the example given above and consequently the order in which the transition matrices are applied is very important. In the example given above, if marriage is determined first, then the potential fertility rate changes and similarly, a pre-marital pregnancy will increase the probability of getting married. Galler (1997) discussed a number of options in this situation including the procedure of random ordering as used by the DARMSTADT (Heike et al., 1987) and Hungarian models (Csicsman et al., 1987).
There are a number of other problems with this type of approach. Firstly transitions are assumed to take place at a single point in each time period and the duration of the event must last at least one time period (typically a year, but may be of shorter duration). For example if the time period is a year, this approach rules out transitions in and out of unemployment over the course of a year, which is unrealistic, as many people will have unemployment transitions for periods of less than one year as in the case of seasonal workers. Therefore, the discrete time transitions simulate net transitions (see Galler, 1997) at discrete points in time, ignoring the transition path taken to reach the end state. Some models, e.g. MICROHUS and SESIM, therefore developed a workaround where the end state is stimulated together with an extra variable describing the transition. Take unemployment as an example, the method simulates both the employment status (end state) and the length of unemployment, which can be used to partially describe the transition with greater details.
Continuous time microsimulation models, on the other hand, usually use survival models to simulate the time of events. Rather than simulating annual transition probabilities, survival functions model the length of time an individual will face in his/her current state, e.g. DYNAMOD and SOCSIM (Hammel et al., 1990) and this method was extensively discussed by Willekens (2006). Once a referencing event has occurred such as marriage, an individual is passed through each survival function that they are eligible for given their current states. For example, once an individual is married, they become eligible for divorce, the event given their current state with the nearest event time is selected and then repeated until death.
While the continuous time model has some theoretical advantages as it pinpoints the time of events, it also suffers from considerable practical limitations. The estimation of competing risks and survival functions place very high requirements on the data that are rarely matched by the actual data available (Zaidi & Rake, 2001). Given that most base datasets were collected yearly and many taxation procedures are reviewed annually, it is easier to incorporate a discrete time framework. Although a continuous time model could simulate the sequence of event occurrences, it still faces the estimation problems of interdependent processes and correlated errors. In addition, the potential interdependence of transitions for members (e.g. family) further raises the complexity of implementation. Alignment for continuous models is more difficult as cross-sectional adjustments would erode the advantages of duration models, and the potential computation cost of alignment is much higher in continuous time models.
3.6 Open versus closed model
A decision dynamic microsimulation model builder has to consider is whether the model should be open, closed or a mixture of the two. A model is often considered closed if, except in the case of new born and migrants, the model only uses a fixed set of individuals to create and maintain social links. Thus, if an individual is selected to be married, then their spouse is selected from within the existing population of the model. Similarly, a baby is always attached to a family within the sample. In contrast, an open model starts with a base population and if spouses are required, then new individuals are generated exogenously. This has the advantage that simulations for individuals (and their immediate families) can be run independently of other individuals, and thus allows the model to be run in parallel on different computer processors, allowing overall run times to be reduced (O’Donoghue, 2001a).
Open models, for instance, PENSIM and LifePaths, have the advantage of having simpler interaction models, e.g. a newly married partner can be created artificially to fit the social economic characteristics of an individual. However, an open model is more difficult for matching external macro aggregates as the sample may not stay representative of the population as new individuals are created. Although possible, it is a non-trivial task to align a varying population with macro-aggregates, as the process would require constant dynamic reweighting and in the case of heavy alignments, the benefits of running the model in parallel might be lost. As a result, most dynamic models in use utilise a closed model method.
3.7 Link between micro and macro models
As many policy indicators (e.g. employment rate) are at macro level, microsimulation models increasingly find the need to interact with macro economy through either an alignment process or computational general equilibrium (CGE) feedback. Alignment, as discussed in earlier, offers a simple but limited way to enforce the aggregate statistics within a simulation; however, it is usually limited to very specific variables and does not change based on the feedback from simulated micro data. Besides alignment, it is also possible to use CGE models to link macro, meso and micro models (see Ahmed and O’Donoghue, 2007; Davies 2004). CGE models offer a potential opportunity to allow macro models interact with micro models via prices in different markets, which is particular useful for analysing large scale macroeconomic shock. For instance, IFSIM (Baroni et al., 2009) links a microsimulation model with a simple CGE model assuming a single sector economy.
There are a few papers discussing the potential methods of linking a microsimulation model and a CGE model. Cockburn (2001) used an integrated approach to link a survey dataset within a CGE framework, where the main concept was to replace the traditional unit of analysis in CGE, representative household, with a real household. Another approach is to separate macro and micro components while allowing the result of the micro or macro models being fed into the other models. Depending on the direction of the output feeding and the number of iterations, this approach was further subcategorised into “Top-Down”, “Bottom-Up”, “Top-Down Bottom-Up” and “Iterated Top-Down Bottom-Up” approaches (Galler, 1990; Baekgaard, 1995; Savard, 2003). Colombo (2010) compared several CGE microsimulation linkage methods and suggested the “Iterated Top-Down Bottom-Up” as the currently most complete approach. However, with only few exceptions like NEDYMAS (Dekkers et al., 1993) which used the iterated approach, most macro-micro linking attempts in dynamic microsimulation models are limited to one-way only.
At the current stage, the integration of CGE with microsimulation is still limited due to several factors, including modelling complexity, data issues, model stability and computational costs. (Ahmed & O’Donoghue, 2007) Robilliard & Robinson (2003) indicated that current approaches in linking micro-macro may still need to be refined before addressing distributional issues. In addition, linking with CGE requires decent quality of household income and expenditure data, which is not widely available. Furthermore, the integration between CGE and dynamic microsimulation could potentially exaggerate the uncertainty introduced in the results due to the complexities in interactions of different social economic variables and consequently result in a greatly increased computation time.
Given the complexity in incorporating complete a CGE model in microsimulation, it might be more feasible to incorporate a partial equilibrium in to the model. A static microsimulation model, IZAΨMOD (Peichl et al., 2010), allows feedback from computed labour market equilibrium to refine the labour supply behavioural response. In a spatial microsimulation model, one may consider to model the feedback from the housing market as illustrated in Hooimeijer (1996). This type of single market equilibrium implementation can avoid the complexity introduced by the social accounting matrix and inaccurate expenditure data.
3.8 Links and integration with agent based models
Although this study mostly focuses on the development of dynamic microsimulation models, it is also worth to note that microsimulation is closely related to two other individual level modelling approaches, cellular automata and agent based models (Williamson, 2007). In particular, agent based models are also used in social science to analyse macro level phenomena gathered from micro units. An agent based model (ABM) typically consists of a set of autonomous decision-making entities (agents), a set of agent relationships and methods of interaction, and the agents’ environment (Macal & North, 2010). It is often used to show how macro level properties such as spatial patterns and levels of cooperation emerge from adaptive behaviours of individuals.
Traditionally, agent based models are highly abstract and theoretical without many direct empirical applications (Boero & Squazzoni, 2005; Janssen & Ostrom, 2006). In recent years, however, there is a growing interest in ABM literature of injecting empirical data in an attempt to simulate some real-world phenomenon (Parker et al., 2003; Hassan et al., 2008). From a practical point of view, when agent based models add more social economic attributes to the agents and when microsimulation models add more behaviour rules and interactions, they are moving toward to a common ground (Williamson, 2007). Some papers, e.g. Eliasson (1991), Baroni et al. (2009) etc., may even use the word interchangeably when behavioural models are included in microsimulation.
Agent based models covers an important aspect of social economic modelling, network effects, which has long been discussed by sociologists and economists but hardly exists in microsimulation beyond the spouse matching. Microsimulation modellers often implicitly assume that the effects of social pressures and peer effects are already embedded in the existing distribution and they are likely to keep constant, i.e. there is no need to update the model as time passes. While this assumption might be acceptable for some research, such as tax reform analysis, it might be too strong for some other types of research, e.g. evaluating alternative health intervention policy. Agent based models, on the other hand, often explicitly model these interactions and allow certain social factors to change as the population evolves.
With the growing number of social networking data, it becomes possible to integrate the empirically-tested adaptive behaviours from ABM into microsimulation models to produce a more realistic model. The potential introduction of network effects could benefit a set of microsimulation models, e.g. health simulation models, in which the social factors may play a role. In addition, peer effects may also help to model the evolution of marriage/fertility patterns, the formations and dissolutions of neighbourhoods in a spatial microsimulation model etc.
It should also be noted that this potential integration may also bring some disadvantages. The implementations of micro interactions would greatly increase the computational cost and complexity, thus makes the model more difficult to understand and validate. Besides, the current base datasets of the microsimulation models are often standard surveys or census data that do not cover extensive network attributes. At the current stage, the implementation of extensive interactions like ABM in microsimulation models is still at its infancy, the existing attempts are limited to the introduction of simple behaviour rules, e.g. copying consumption habits as in Lawson (2011).
4. Estimations and validations of microsimulation models
4.1 Modelling transitions and behaviours
Microsimulation models could use structural behavioural models, reduced form statistical model or simple transition matrix to simulate changes. Behavioural models are grounded in economic theory, in the sense that changes to institutional or market characteristics result in a change in the behaviour of agents within the model. In contrast, reduced form statistical models aim to model the transition probabilities of individual characteristics using related variables. It aims to reproduce observed distributional characteristics in sample surveys without explicit considerations on policies. Reduced form models usually do not respond to external market and institutional characteristics and assume a stable policy environment implicitly. Transition matrix is often a time-homogeneous Markov chain with limited number of states (e.g. age group, gender). It is the easiest way to model potential changes with least theoretical considerations.
Reduced form models and transition matrices are often used to simulate mortality, fertility, family formation, labour market transitions etc. As these models usually do not depend on policy parameters, they are not suitable for reform analysis, and are often restricted to simulating status quo only. The method is often used in static tax benefit microsimulation models as well as demographic components of dynamic microsimulation models.
In a structural behavioural model, individual behaviour changes are as a result of changing policies, therefore the policy parameters must have a direct or indirect impact on the model. An example could be a labour supply model that responds to changes in the tax-benefit system. Behavioural models in microsimulation should be relevant to overall model objectives, able to introduce behavioural adjustments to policy changes. Examples of behavioural responses that fit these requirements include labour supply, retirement decisions, the effect of income and price changes on consumption, fertility and marital decisions, the take-up of social benefits etc. A behavioural model may contain multiple components. In the case of labour supply models, behaviour simulation models typically consist of three parts: an arithmetic tax benefit model to estimate budget constraints, a quantifiable behaviour model using variables that can be simulated, and a mechanism to predict the labour supply under a new policy environment (Creedy et al., 2002).
Compared with earlier microsimulation models, more models today have incorporated behavioural responses into their designs although these responses are often limited to labour market simulations. Models such as MICROHUS (Klevmarken & Olovsson, 1996), PRISM (Kennell & Sheils, 1990), NEDYMAS (Dekkers et al., 1993), LIAM (O’Donoghue et al., 2009) all incorporate labour supply behavioural responses to the tax-benefit system, SESIM (Klevmarken & Lindgren, 2008), DYNAMITE (Ando et al., 2000), and SADNAP (Van Sonsbeek, 2010) model retirement decisions depending on the social security system. However, there is still only limited implementation of life-cycle models in microsimulation and the study on the impact of prediction errors on simulation results is scarce.
4.2 Alignment with projections
As statistical models are typically estimated using historical datasets with specific characteristics and period effects, projections of the future may therefore contain errors or may not correspond to exogenous expectations of future events. In addition, the complexity of micro behaviour modelling may mean that simulation models may over or under predict the occurrence of a certain event, even in a well-specified model (Duncan & Weeks, 1998). Because of these issues, methods of calibration known as alignment have been developed within the microsimulation literature to correct for issues related to the adequacy of micro projections.
Scott (2001) defines alignment as “a process of constraining model output to conform more closely to externally derived macro-data (‘targets’)”. Clearly, in an ideal world, a system of equations would be estimated that could replicate reality and give effective future projections without the need for alignment. However, as Winder (2000) stated, “microsimulation models usually fail to simulate known time-series data. By aligning the model, goodness of fit to an observed time series can be guaranteed.” Some modellers suggest that alignment is an effective pragmatic solution for highly complex models (O’Donoghue, 2010), as it offers a limited connection between micro and macro data.
Alignment also has its downsides, as highlighted by Baekgaard (2002). Concerns raised regarding alignment include the issue of consistency within the estimates and the level of disaggregation at which this should occur. The implementation of alignment may twist the relations of key variables in an undesired way (Li & O’Donoghue, 2013). The existence of an alignment mechanism may constrain model outputs to always hit aggregate targets even if there has been an underlying behavioural or structural change. An example would be if education levels rose, as this would be expected to reduce mortality rates and increase female labour force participation. If the alignment mechanism for each process did not incorporate the impact of educational achievement, then an increase in the education level would have no effect on these aggregates. It has been suggested that equations should be reformulated rather than constrained ex post. Klevmarken (2002) demonstrated various potential methods in incorporating alignment information in estimations. In most cases, alignment methods are only documented briefly as a minor technical part of the main model. Currently, there is very limited number of studies analysing how projections and distributions change as a result of the use of different alignment methods.
Despite the potential pitfall of its statistical properties, aligning the output of a microsimulation model to exogenous assumptions has become standard over the past decade. As Anderson (2001) noted, almost all existing dynamic microsimulation models are adjusted to align to external projections of aggregate or group variables when used for policy analysis. Continuous variables such as earnings are typically aligned with a fix ratio in order to meet the projected average or distribution, whilst binary variables, such as working status, are aligned with various methods, including multiplicative scaling, sidewalk, sorting based algorithms etc. (See Morrison, 2006). Microsimulation models using historical datasets, e.g. CORSIM, align their output to historical data to create a more credible profile (SOA, 1997), while models that work prospectively, e.g. APPSIM, also utilise the technique to align their simulations with external projections (Kelly & Percival, 2009).
4.3 Model complexity
Dynamic microsimulation is mostly built on the assumed parameters, estimated Markov chains and the conditional probability distributions estimated by various econometric methods. It usually involves many equations and parameters, estimated and fixed by laws and regulations. Once the estimations and parameters are put in place, most microsimulation models follow a straightforward execution process without invoking computational complicated algorithms. The complexity of a model, as a result, often comes from the constructions of the economic models and is mostly guided by the potential policy questions that the model is required to answer. Models focusing on pension issues usually simulate detailed labour market behaviour for decades ahead, as a change in the pension system can only mature when the youngest cohort in the labour market retires. In contrast, short term tax policy models usually forward simulate 3 to 5 years and are typically limited to tax related variables only. If a model is being utilised to answer different research questions, then it usually needs to simulate more variables for a longer period of time, which involves higher levels of complexity.
An ideal microsimulation model should have the capacity to simulate details of all possibly related variables; however, the costs of building large models, both in terms of model validity and management needs to be taken into consideration. Dynamic microsimulation models have the reputation of being complex and the potential to run “out-of-spin” with regard to some aspects. This might be a particular concern when simulating policy reforms. Economics models, especially reduced form models, are often criticised for simulation purpose as the stability of the model structure is questionable under policy changes. This argument is also widely known as Lucas’ critique. As a result, structural models are usually seen as a better choice. Since some part of the policies (e.g. tax) can be explicitly included in the structural model, the estimated utility parameters are perceived to be more stable (Klevmarken & Lindgren, 2008), although utility parameters can sometimes be very sensitive to even a small change in the model specification. Over fitting may also be a potential issue when the list of explanatory variables grows. Due to the number of models that one microsimulation model can invoke and the budget/time constraints, many models are primarily constructed using reduced form models with some structural models in key components.
Complex models, while having more power, are much more difficult to validate and may often contain bugs in their implementation. In addition, the complexity of the processes often means development takes longer than expected. Large general purpose microsimulation models are usually built by large teams with access to large and complex datasets. These models usually simulate a wide variety of economic and demographic processes and can therefore be used for many different applications. These forecasting models usually incorporate alignment systems in order to keep the model in line with external forecasts or are in fact linked to macro-models. Models of this type include DYNASIM from the US, DYNACAN in Canada, SESIM in Sweden, MOSART in Norway and the APPSIM in Australia etc.
4.4 Model validation
Given the increasing complexity of models, it becomes increasingly important to validate the model in order to maintain its credibility. Unfortunately, only limited effort has been placed on validation matters and there is no international consensus on validation procedures. Klevmarken and Lindgren (2008) suggest that validation should be put in the same context as estimation and testing, and should involve the identification of all sources of errors and their properties. Given the size and structure of a large microsimulation model, bootstrapping and Monte Carlo exercises are likely to be more practical than the analytical deduction. In addition, sensitivity analysis on the models should also be part of the microsimulation validations (Klevmarken & Lindgren, 2008). In Morrison (2008)’s paper, DYNACAN published their method of the validation from a practical point of view. It lists several important components one should cover during a microsimulation validation process: context of validation, data/coefficient/parameter validation, programmers/algorithmic validation, module-specific validation, multi-module validation, and policy impact validation.
Ex post analyses of previous periods can also be used to assess the reliability of a model and it is for this reason that a number of the major microsimulation projects have taken historic datasets as their starting population base for simulations. For example, the CORSIM and POLISIM models takes as their base a sub-sample of the 1971 and 1960 US Censuses respectively, and the DYNACAN model takes a sample of the 1970 Canadian Census as its base. By running the model forward to the present day, the model forecasts can be compared to what has actually happened (see for examples Morrison, 2000; Caldwell & Morrison, 2000). However, these models invariably incorporate historical information such as macro-aggregates into the model and as this information would not have been known to forecasters, this may produce better forecasts than would have otherwise been the case. One method to overcome this is to compare directly generated forecasts with what happened in reality, for example comparing forecasted labour participation rates with actual rates. Another method described by Caldwell (1996) is to use an indirect approach, known as a multiple module approach. An example cited by Caldwell is the case of validating the numbers of married persons with health insurance, when the directly simulated processes are marriage and medical insurance membership. Sources of error may result from errors in either or both direct processes, or because of mis-specified interactions.
Some types of dynamic models, however, may have no comparable data source for validation. For example, some theoretical models that solely look at a single cohort living in a steady state have nothing with which they can be validated through external data source as they do not attempt to mimic real life in a comprehensive style. These types of models, due to the lack of validations, are often restricted in their interpretations of policy impact. Additionally, countries that have only recently developed their micro-data resources may not have alternative sources of data with which to validate, although this problem will become progressively less with time.
Recent developments suggest an alternative validation method using a simplified model. Since no future data is available to validate a forecasting dynamic microsimulation model, Morrison (2008) suggests comparing a model’s result to a trustworthy model’s result. Dekkers (2010) argues that the general trend of certain indicators estimated by a simple model could be seen as a benchmark for more complicated microsimulation model as there is no black box in a simple model. The Belgium MIDAS model used this approach to validate against a “simple stylised” model, which is essentially a representative household model with only demographic and pension indexation components. This approach, however, raises another question on the criteria of a “trustworthy” model. It is difficult to say which model is correct when the output of a stylised benchmark model differs significantly from the result of a comprehensive population model. Without further analysis, the differences between model outputs may only be used as indicative validation tests rather than anything conclusive.
5. Programming of dynamic micro-simulation models
Microsimulation models are usually built for specific purposes and are thus custom developed, although there are a few packages that are often used in the development of dynamic microsimulation model. These packages can be grouped in to three main categories according to their development environments, each with their own advantages and disadvantages:
General purpose programming language tool (C/C++/C#/Java etc.)
General purpose statistical package (Stata/SAS/R/MatLab/Mathematica etc.)
Simulation modelling package (Modgen, LIAM2, GENESIS etc.)
Development using a general purpose programming language clearly enjoys the highest degree of flexibility and possibly speed advantage. FORTRAN was popular among some earlier models, e.g. MICROHUS, PRISM, and DYNASIM2 while C language family seems to be a popular choice for later models. SAGE, DYNAMOD, LIAM, DYNACAN and a few others models were all developed using C++, whilst POLISIM used a mixture of C and C++, and APPSIM and MOSART were programmed in C#. Models have also been developed in Java (e.g. IFSIM), Visual Basic (e.g. SESIM) and a number of other languages. Evaluation based on the prototype microsimulation models by Percival (2007) suggested that there is a substantial speed advantage when the prototype model is coded using C++. However, the cost of development is much higher when compared with other approaches, as all the potential numeric calculations and related data management need to be programmed. In practice, it is likely that policy modellers are not adequately proficient in programming, while professional programmers may not fully understand the economic theories and scientific principles that are to be implemented.
The second approach is to develop microsimulation models based on existing statistical or mathematics packages, such as GAMEO, DYNASIM, and PENSIM2 which were built on SAS. Modern statistical packages are capable of executing computation commands in batch and the code of a model is commonly referred to as a “script”, “do-file” or “syntax file” etc. The main advantage of this approach is short development time and easy access to the statistical power of the package. However, the speed of the model might be lower and the data structure may not be optimised for simulation purpose.
Another way to develop microsimulation models is to use modelling packages developed by the third parties. Software in this category ranges from generic purpose modelling software, e.g. AnyLogic etc. to microsimulation specific packages. Whilst agent based simulation modellers use more generic purpose packages, microsimulation modellers tend to use more specific software.
The most notable dynamic microsimulation modelling tools include
Modgen, developed by Statistics Canada (Wolfson & Rowe, 1998)
LIAM2, developed by the Belgium Federal Planning Bureau (Bryon et al., 2011)
UMDBS, developed by Sauerbier (2002)
GENESIS, developed by UK Department for Work and Pensions (Edwards, 2004)
JAMSIM, developed by Centre of Methods and Policy Application in the Social Science (COMPASS), University of Auckland (Mannion et al., 2012)
LIAM, developed by O’Donoghue et al. (2009)
Modgen provides a C++ library for developers to incorporate required common actions and modules. It is often used to develop continuous microsimulation models, such as LifePath. In contrast, LIAM2 is a microsimulation scripting engine which is capable of reading its own syntax. The engine itself is coded in Python with extensive references to libraries written in C. Microsimulation packages such as this one offer the great benefit of rapid development. There are also a few dynamic microsimulation models that were built with generic deployment in mind. For example, LIAM avoids hardcoded parameters and variable names during the development, which greatly reduce the repetitive work load of a new modeller. GENESIS offers a platform to create a SAS based microsimulation model by reading the model specification from an Excel Sheet. JAMSIM combines several opens source packages, e.g. R, Ascape, to create a user friendly interface to model and execute microsimulation models. However, these models still require end users to understand the internal mechanism and make changes at source code level when building larger models.
Most models today are based on a statistical package or a generic purpose programming language. However, it is not uncommon to see mixed combinations of environments in order to utilise the advantages of different software, especially for pre- or post-simulation analysis, e.g. DYNACAN, LIAM.
6. Progress in dynamic micro-simulation
6.1 Progress of dynamic microsimulation modelling since 1970s
In reviewing progress made by the field, it is useful to consider an early model development, the DYNASIM model developed by Orcutt et al. (1976) in the Urban Institute in the early 1960s to mid 1970’s. In terms of our classification above, DYNASIM was a longitudinal closed model running a 10000 person dataset. It contained
A demographic module, modelling leaving home, births, deaths partnership formation and dissolution, disability, education and broad location.
A labour market module containing participation, hours, unemployment and labour income
A Tax-Transfer and Wealth module containing capital income and the main tax and transfer instruments
A marriage matching module
As well as a simple macroeconomic model and feedback loops linked with the microsimulation model via alignment.
Thus in terms of generic structure, this 1970s model incorporates much of what has been included in later dynamic microsimulation models, although each component has been largely improved by the newer models. Despite the progresses in 1970s and 1980s, early microsimulation modellers faced a number of challenges which were summarised by Hoschka (1986):
Many of the behavioural hypotheses in micro-simulation models are of insufficient theoretical and/or empirical basis
Dynamic changes in the behaviour of the population are mostly not regarded by micro modellers
The problems of including more than the primary effects of a policy programme is still unresolved
Quality and accessibility of the data required by micro models often are restricted severely.
The development of micro-models frequently needs too much time and its costs are accordingly high
Running micro models usually requires a lot of computer time
The prediction quality of micro-models has not yet been systematically evaluated and validated
Large microsimulation models are so complex that they are difficult to comprehend and control.
These challenges can be broadly categorised into five different areas: behaviour response modelling (a-c), microdata quality (d), development cost (e), limited computation capacity (f) and model validation (g-h). Comparing with some recent discussions in issues of microsimulation (Harding, 2007b), it is clear that most issues mentioned are still relevant and high on the list several decades later.
By comparing the DYNASIM model structure with today’s dynamic microsimulation models and the challenges faced by the modellers in 1980s and today, what we are seeing are gradual advancements in the methodologies rather than breakthrough in model designs and applications. Improved computer hardware has allowed both improved speed and increased databases as have model software developments such as Scott (2001), O’Donoghue et al. (2009) etc. Improvements in good data and the software packages with built-in micro-econometric techniques have improved the sophistication possible in individual models (See O’Donoghue, 2001a). There has been some improvement also in the incorporation of behavioural response. This allows us to analyse the social economic impact on individuals when the policies are not kept constant. In addition, today’s microsimulation modellers have proposed several methods to systematically validate the simulation output (Morrison, 2008). Another major advancement in the past decades is the emerge of generic models, including Modgen (Wolfson & Rowe, 1998), UMDBS (Sauerbier, 2002), GENESIS (Edwards, 2004), LIAM (O’Donoghue et al., 2009) and LIAM2 (Bryon et al., 2011). These generic models can greatly reduce the workload of new modellers by providing commonly used microsimulation routines.
6.2 Obstacles in the advancement of microsimulation
While the field of microsimulation has progressed greatly in many aspects since the original paper of Orcutt (Williamson et al., 2009), the rate of progress in dynamic microsimulation, nonetheless, is arguably slow given that we still share the same model design and face similar problems as early DYNASIM modellers did nearly 40 years ago. There are a number of reasons could be ascribed to this lack of progress, including:
Knowledge transfer
Model ownership
Unrealistic expectations
Funding
One criticism of the knowledge transfer mechanisms within the field is that most of the transfer has been via tacit knowledge rather than codified knowledge. Much important knowledge and methodologies have mainly been codified as “documentation”, with the main aim to facilitate other team members utilising the models. In addition, microsimulation models are mostly developed in governmental or policy institutions, where developing a literature on which a wider group of scientists has built has been a lesser objective. Furthermore, the documents are mainly spread with limited books and conference presentations, which may not be easily available for researchers outside of the network. Additionally, academic publication relies on preparing papers of 5 to 10 thousand words, which may not be enough for complex dynamic microsimulation models. Thus a significant proportion of the extensive methods used in the field are not formally codified, meaning that to a large extent new models have had to reinvent the wheel and redevelop existing methods over and over again. This has made it very difficult to work in the field.
The non-transparent knowledge transfer has also manifested itself in a proprietary versus open source view in relation to the software, where either code or coding consultancy has been sold to potential clients. While this model of intellectual property makes sense when an economic return can be gained and motives private R&D, given the relatively small demand for these tools by clients with the capacity to pay for them, it seems to be a business model that will stymie intellectual development. With low funded demand, the returns will be low, limiting private investment, while the private good nature of the intellectual property will limit transmission. In addition, the protection of the source code makes replicating others’ findings very difficult, which could harm the credibility of the research. Moving from black box” modelling to a glass box” modelling could ease many potential users’ concerns and raise the method’s scientific status (Wolfson, 2009). The availability of less closed model frameworks such as GENESIS, LIAM and LIAM2 can facilitate the development of new models. However it will require the publication of full models to fully realise the benefits of scientific interaction.
Another reason for the lack of progress might be the perceived “failure” of the earlier models. However this failure to some extent can be attributed to failing to meet unachievably high expectations. Orcutt et al. (1961) focused on the capacity to undertake prediction at a micro level to facilitate planning. Human behaviour is of such complexity and is endogenous to economic analysis that dynamic microsimulation models cannot hope to make highly accurate predictions. Even well specified econometric model may over or under predict the outcomes (Duncan & Weeks, 1998). As George Box (1987) said “All models are wrong, some are useful”. In being useful we can hope, by using good theory, data and statistical and computational methods, dynamic microsimulation models can provide a consistent and reasonable framework with which to undertake policies analyses incorporating inter-temporal events and the distribution of the population.
Funding may also be a major issue facing many microsimulation modellers. Building and using large microsimulation models requires teams of researchers representing different disciplines and experiences. In addition, the scale of the model also suggests the need for long-term funding, which does not always fit well into an ordinary university department with its normal rotation of people and the three-year funding of research projects. After the initial funding, most models are no longer actively maintained, which makes very difficult for people outside of the original team to utilise the model for other research purposes.
7. Future directions
7.1 Model uses
The applications of microsimulation are widespread as suggested by Table 1. With the availability of better modelling tools and greater number of researchers from different fields engaging in microsimulation, the method is now applied in many fields other than the traditional welfare policy research. For instance, using microsimulation model as part of the tools to estimate impact of climate change (Hynes et al., 2009; Buddelmeyer et al., 2009), modelling disease spread (Will et al., 2001), time use simulation (Anderson et al., 2009), and even to assist personal financial planning (Avery & Morrison, 2011). The use of dynamic microsimulation models can be even further expanded as more micro-level data becomes available. With the better availability of the longitudinal data and administrative data, it is possible to better understand the consequence of ageing. In addition, the raise of the network data could help to model the disease spread and knowledge diffusion in a more realistic way.
While large dynamic models have their advantages for providing more comprehensive simulation outputs, the complexity also increases the difficulties in validation, model usages and also funding issues. It might be beneficial to also develop some specialised simple dynamic models. Smaller models could be better validated and make it easier to publish the model details within the length limit of a journal article. This does not mean that there is no need for large models. Instead, the easy-to-validate smaller models could be absorbed into a more complicated microsimulation model where more complex interactions are allowed.
Additionally, instead of expecting an accurate long run simulation, researchers could focus more on scenario analyses, where the assumptions are explicit and there is less pressure to be a fortune teller. The changes in economic and politics climate also mean that all the simulations results may become obsolete in relative short time. Focusing on the scenario analyses could be more cost effective and relevant to the debate of contemporary issues.
Furthermore, academics can also use dynamic microsimulation to improve the understanding and modelling of inter temporal behaviours. Traditionally, labour economists do not have access to the longitudinal data that covers the whole life-span of individuals. With the help of microsimulation, it is possible to generate budget constraints for use as input into life-cycle behaviour choice modelling, e.g. retirement choice as in Li and O’Donoghue (2011). The method may assist us to better understand the many inter temporal processes, e.g. fertility decision, education choices etc. The raising interests from the academic side would benefit the field development and ensures the sustainability of the knowledge.
7.2 Model assumptions and potential expansions
While the models that focus on the individual social economic patterns and behaviours have improved in the past decade, there is limited effort modelling the institutions except tax benefit system within microsimulation. Future models could potentially benefit from incorporating some of these important social fabrics, e.g. companies, unions in a labour market simulation exercise, or hospitals, clinics, emergency response in a health model. This also relates to the discussions of better behaviour modelling and CGE models linkage referred in earlier section. These improvements could potentially provide us a more accurate picture of the consequences of large scale policy change.
A number of the typical assumptions in microsimulation can also be further explored. For instance, the unit of analysis is traditionally individual or nuclear family. It is useful to consider more complex household arrangements to be comparable with the welfare economics literature. Also, the sharing within household assumption may not hold if there’s complex family structure. By modelling the kinships within the family, like INAHSIM (Inagaki, 2010), it allows us to better understand the welfare network and poverty alleviations in the society. In addition, most microsimulation models these days ignore the budget and political constraint from the government side, either by assuming fiscally neutral or unlimited resources. The macroeconomic constraint and the political feasibilities are not discussed in most papers. Future microsimulation modellers may want to incorporate these factors to assess the feasibilities of a proposed reform.
7.3 Methodologies and technical choices
In terms of methodological development, a primary need is to codify the various methodologies that are currently being used in dynamic microsimulation models. There are many methods being used; most without any published description or evaluation. As noted above, this can impede the progress of the field. Formally documenting the methods used and publishing in a peer-reviewed journal could improve the knowledge diffusion and increase the public good returns by academics, providing incentive to innovate. Additionally, publications could preserve the knowledge that could have been lost due to the end of project funding. It is hoped that in time that the newly founded International Journal of Microsimulation can provide an opportunity for citable peer reviewed publications.
The widely used alignment technique is still under documented. While some models have published their alignment implementation details, it is still unclear how alignment should be used when combined with more complex econometric models, e.g. categorical behaviour models. Generally, there is limited understanding on the simulation properties of many algorithms used, including alignment, error term manipulation, complex reweighting, random numbers etc. In most models, each equation is estimated separately without the considering the potential correlated error terms and the simulation structure where the equations will be applied to. This may lead to undesired bias due to inconsistent assumptions when simulating some reforms. In addition, to improve the model credibility, it is worthwhile to pay attention to the testing and validation process of a simulation model. Additionally, papers using microsimulation model typically provide the result of only one-run although a few papers, e.g. Pudney and Sutherland (1994) found that the microsimulation results could have a wide confidence interval. Given the raising computing capacity available for researchers these days, modellers could potentially provide more information about the simulation, e.g. the confidence intervals of the result using Monte Carlo techniques.
Despite the discussions and the general consensus to improve validation process in microsimulation, there is still little guideline how dynamic microsimulation models should be validated (Harding, 2010). While DYNASIM documented many issues involved in the model validation, there are still many areas that need to be explored, such as behaviour responses validation, longitudinal consistency validation, module interactions etc. Besides the validation from the technical side, it is also worth considering to validate the simulation with historical data, from which we can learn what has been done right, how the simulation performs under different assumptions etc.
8. Conclusions
This paper has discussed some of main issues involved in constructing a dynamic microsimulation model and described some of the choices made by different models in use worldwide. The main issues discussed have covered some of the general model development issues, such as base dataset selection, cohort or population based model structure, programming environment, and model validation. The paper has also discussed some of the technical choices made in model implementation, such as whether the model should be open or closed, whether alignment algorithms should be used, whether the model should incorporate behavioural response to policy changes, and links to the agent based models etc.
Over the past decades, microsimulation models have been applied to many different policy areas and a comparison of models as given in Table 1 illustrates the scope of application of dynamic microsimulation models. Most dynamic microsimulation models listed can be categorised as discrete models using dynamic ageing approach. For newer models, alignment has become a standard component allowing interactions with macro aggregates and more recently, simulation packages that are dedicated solely to microsimulation have become a viable option in model development. These packages, together with increased co-operation through meetings and code sharing (e.g. LIAM, Modgen model series), could significantly increase the development process.
The increasing use of microsimulation models has raised many technical challenges to meet the needs of more complex and accurate policy analyses. For instance, there is a growing interest in integrating CGE into microsimulation models, although the actual implementations of CGE-microsimulation are at this stage restricted due to data and technical limitations. Behavioural responses in microsimulation could also be further improved and one should consider more life-cycle models when simulating inter-temporal choices. Microsimulation models could potentially implement some elements from ABM to allow dynamic behaviour interactions and adaptations. In addition, considering different unit of analysis, budget and political constraints, may also broaden the field of microsimulation applications. Furthermore, certain practices within the simulations, such as alignment for complex models and error term simulation, should be more thoroughly studied.
Besides the technical challenges, there are also some general issues in the field. The lack of documentations often forces new modellers to reinvent the wheel; closed sourced models which slow down the knowledge transmission. The unrealistically high expectation in long run simulation may challenge the creditability of the model and make applying for funding more difficult in long run. Future modellers may help to address these issues by publishing model details in academic journals and be more open on the algorithm implementations. Newer modelling platforms like LIAM2 attempt to be more open and transparent in the software source code, which would potentially benefit the field development and knowledge transmission. In addition, the field can also explore topics other than taxations and standard government policies. Topics like the impact of climate change, the social consequence of ageing, for instance, could also potentially gain benefits from microsimulation techniques.
References
-
1
CGE-microsimulation modelling: a survey. MPRA Paper 9307Germany: University Library of Munich.
-
2
Time and Money in Space: Estimating Household Expenditure and Time Use at the Small Area Level in Great BritainNew Frontiers in Microsimulation Modelling, Public Policy and Social Welfare 36.
-
3
Models for Retirement Policy AnalysisModels for Retirement Policy Analysis, Report to the Society of Actuaries, USA.
-
4
Microsimuation Analysis of Aggregate Savings Behaviour in Japan: Effects of Aging Population on Aggregate Savings and Design of Policies on Savings in JapanNational Institute for Research Advancement.
- 5
-
6
Demographic dynamics, labor force participation and household asset accumulation: case of Japan. NBER Working Paper No. 5261Demographic dynamics, labor force participation and household asset accumulation: case of Japan. NBER Working Paper No. 5261.
-
7
A micro simulation model of demographic development and households’ economic behavior in ItalyBank of Italy, Economic Research Department.
-
8
The Future Burden of Public Pension Benefits A Microsimulation Study. Discussion Papers No. 115The Future Burden of Public Pension Benefits A Microsimulation Study. Discussion Papers No. 115, Statistics Norway.
-
9
An introduction to DYNAMOD: A dynamic microsimulation model. DYNAMOD Technical Paper No 1An introduction to DYNAMOD: A dynamic microsimulation model. DYNAMOD Technical Paper No 1.
- 10
-
11
Microsimulation as a Financial Literacy Tool: Assessing the Consequences of Decisions to WorkSave, Retire, and Spend, IMA Conference.
-
12
National Centre for Social and Economic Modelling (NATSEM)Integrating micro and macro models: mutual benefits, National Centre for Social and Economic Modelling (NATSEM), University of Canberra.
-
13
National Centre for Social and Economic Modelling (NATSEM)The distribution of household wealth in Australia: 1986 and 1993, Discussion Paper no. 34, National Centre for Social and Economic Modelling (NATSEM), University of Canberra, Australia.
-
14
National Centre for Social and Economic Modelling(NATSEM). Technical paper No. 25National Centre for Social and Economic Modelling(NATSEM). Technical paper No. 25.
-
15
Inequality and redistribution over the life-cycle in Italy: An analysis with a dynamic cohort microsimulation modelBrazilian Electronic Journal of Economics 4:32.
-
16
SimBritain: a spatial microsimulation approach to population dynamicsPopulation, Space and Place 11:13–34.
-
17
Building a dynamic spatial microsimulation model for IrelandPopulation, Space and Place 11:157–172.
-
18
Un outil de prospective des retraites: le modèle de microsimulation DestinieEconomie & prévision pp. 193–213.
- 19
-
20
The Destinie 2 microsimulation model: increased flexibility and adaptation to users’ needsIMA Conference.
-
21
Does empirical embeddedness matter? Methodological issues on agent-based models for analytical social scienceJournal of Artificial Societies and Social Simulation 8.
-
22
Le modèle de microsimulation dynamique destinieDivision Redistribution et Politiques Sociales G 9913.
-
23
Microsimulation in the new millennium: challenges and innovationsPublic pensions in a dynamic microanalytic framework: the case of France, (Eds.), Microsimulation in the new millennium: challenges and innovations, Cambridge University Press, Cambridge.
- 24
-
25
Pensioner poverty over the next decade: what role for tax and benefit reform?The Institute for Fiscal Studies.
-
26
How fee and insurance changes could affect dentistry: results from a microsimulation modelThe Journal of the American Dental Association 126:449–459.
-
27
LIAM 2 User Guide documentation MiDaL Project Document
-
28
Linking a Dynamic CGE Model and a Microsimulation Model: Climate Change Mitigation Poliices and Income Distribution in AustraliaUniversity of Melbourne: Melbourne Institute of Applied Economic and Social Research.
-
29
Health, wealth, pensions and life paths: the CORSIM dynamic microsimulation modelContributions to Economic Analysis 232:505–522.
- 30
-
31
Validation of longitudinal dynamic microsimulation models: experience with CORSIM and DYNACANUniversity of Cambridge: Department of Applied Economics.
-
32
Problems and Prospects for Dynamic Microsimulation: A Review and lessons for APPSIM. Discussion Paper no. 63University of Canberra: NATSEM.
-
33
Individual alignment and group processing: an application to migration processes in DYNACANUniversity of Cambridge: Department of Applied Economics.
-
34
Earnings in DYNACAN: distribution alignment methodology. DYNACAN Working PaperHuman Resources Development Canada.
- 35
-
36
The Uses of Microsimulation Modelling. Technical PapersWashington, DC: National Academy Press.
-
37
Trade liberalisation and poverty in Nepal: A computable general equilibrium micro simulation analysisCahier de recherche pp. 01–18.
-
38
Linking CGE and Microsimulation Models: A Comparison of Different ApproachesZEW-Centre for European Economic Research Discussion Paper No. 08-054.
-
39
The Simulation of the Educational Output over the Life Course: The GAMEO ModelIMA conference.
-
40
Microsimulation modelling of taxation and the labour market: the Melbourne Institute tax and transfer simulatorCheltenham: Edward Elgar Publishing Limited.
-
41
Decomposing redistributive effects of taxes and transfers in Australia: Annual and lifetime measures185–198, Australian Economic Papers 40.
-
42
The Software Developed for the Hungarian Micro-simulation SystemProceedings of the IIASA Conference on Demographical Micro simulation.
-
43
PENSIM: a dynamic simulation model of pensioners’ incomesLondon, United Kingdom: Department of Social Security.
-
44
Microsimulation, CGE and macro modelling for transition and developing economies, WIDER Discussion Papers 2004/08United Nations University, World Institute for Development Economics Research.
-
45
On the impact of indexation and demographic ageing on inequality among pensioners: Validating MIDAS Belgium using a stylized model, European Workshop on Dynamic microsimulation modellingBelgium: Brussels.
-
46
Micro simulation, pension adequacy and the dynamic model MIDAS: an introductionProject AIM - Deliverable 4.10.
-
47
What are the consequences of the European AWG-projections on the adequacy of pensions? An application of the dynamic micro simulation model MIDAS for Belgium, Germany and Italy. Life-Cycle Microsimulation ModellingConstructing and Using Dynamic Microsimulation Models pp. 325–357.
-
48
The Macro Model Programme Sector of the Microsimulation Model NEDYMAS. WORC paper 93.08.016/2Tilburg University.
-
49
The simulation properties of microsimulation models with static and dynamic ageing – a guide into choosing one type of model over the other
-
50
Generalized raking procedures in survey sampling. Journal of the American Statistical Association1013–1020.
-
51
Simulating transitions using discrete choice modelsPapers and Proceedings of the American Statistical Association 106 pp. 151–156.
-
52
GENESIS: SAS based computing environment for dynamic microsimulation modelsLondon: Mimeo, Department of Work and Pensions.
-
53
Competition and market processes in a simulation model of the Swedish economyThe American Economic Review 67:277–281.
-
54
Modeling the experimentally organized economy* 1:: Complex dynamics in an empirical micro-macro model of endogenous economic growthJournal of Economic Behavior & Organization 16:153–182.
- 55
-
56
Public Policy Analysis and management: Global and Comparative PErspectivesDistributional effects of Public Student Grants in Sweden–a Presentation and an application of the Dynamic Microsimulation Model SESIM, APPAM seminar, Public Policy Analysis and management: Global and Comparative PErspectives, Washington DC.
-
57
A note about SESIM–a dynamic microsimulation model, SESIM DocumentsStockholm: Swedish Ministry of Finance.
-
58
Welfare State Programme, Suntory-Toyota International Centre for Economics and Related DisciplinesA unified funded pension scheme (UFPS) for Britain, Welfare State Programme, Suntory-Toyota International Centre for Economics and Related Disciplines, London School of Economics.
-
59
Microsimulation Models for Public Policy Analysis: New FrontiersPlaying God or LIFEMOD-The construction of a dynamic microsimulation model, (Eds.), Microsimulation Models for Public Policy Analysis: New Frontiers, London.
- 60
-
61
Summary based on the final project report of the dynamic microsimulation model of the Czech RepublicDeloitte.
-
62
Can we afford the future? An evaluation of the new Swedish pension systemIn: A Harding, A Gupta, editors. Modelling our future: population ageing, social security and taxation. Amsterdam: Elsevier. 33.
-
63
An evaluation of social insurance savings accountsPublic Finance and Management 1 pp. 420–448.
-
64
Projections of population, education, labour supply and public pension benefitsSocial and Economic studies 101.
-
65
The MOSART model-a short technical documentationInternational Conference on Population, Ageing and Health: Modelling Our Future.
-
66
Simulation Models in Tax and Transfer Policy279–300, (Eds.), Simulation Models in Tax and Transfer Policy.
-
67
Discrete-time and continuous-time approaches to dynamic microsimulation reconsidered. Technical Paper No. 13National Centre for Social and Economic Modelling.
-
68
Microanalytic Simulation Models to Support Social and Financial Policy Amsterdam227–247, (Eds.), Microanalytic Simulation Models to Support Social and Financial Policy Amsterdam.
-
69
Benefit reform – a dynamic microsimulation approach using administrative dataIMA Conference.
- 70
-
71
The benefits of risk factor prevention in Americans aged 51 years and olderAmerican Journal of Public Health 99.
-
72
Microanalytic Simulation Models to support Social and Financial PolicyLongitudinal Simulation of Lifetime Income, (Eds.), Microanalytic Simulation Models to support Social and Financial Policy, North-Holland Amsterdam.
-
73
SOCSIM II, a sociodemographic microsimulation program, rev. 1.0, operating manual: Graduate Group in Demography Working Paper No. 29Berkeley, California: University of California, Institute of International Studies, Program in Population Research.
-
74
Charging for care in later life: an exercise in dynamic microsimulationIn: L Mitton, H Sutherland, MJ Weeks, editors. Microsimulation in the New Millennium. Cambridge: Cambridge University Press, Cambridge. pp. 226–237.
-
75
Microsimulation Models for Public Policy Analysis: New Frontiers33–66, (Eds.), Microsimulation Models for Public Policy Analysis: New Frontiers.
-
76
Lifetime income distribution and redistribution: Applications of a microsimulation modelLifetime income distribution and redistribution: Applications of a microsimulation model, North-Holland Amsterdam.
-
77
APPSIM: The Australian dynamic population and policy microsimulation modelIMA Conference.
- 78
-
79
Injecting data into simulation: Can agent-based modelling learn from microsimulation, World Congress of Social SimulationInjecting data into simulation: Can agent-based modelling learn from microsimulation, World Congress of Social Simulation, Fairfax, U.S..
-
80
Experiences with the Darmstadt microsimulation model (DPMS)Budapest: International Workshop for Demographic Microsimulation of the IIASA.
-
81
The SVERIGE spatial microsimulation modelInternational Microsimulation Conference on Population.
- 82
- 83
-
84
A life-course approach to urban dynamics: state of the art in and research design for the NetherlandsMicrosimulation for urban and regional policy analysis pp. 28–63.
-
85
Requisite research on methods and tools for microanalytic simulation models. Microanalytic Simulation Models to Support Social and Financial PolicyAmsterdam: North-Holland.
-
86
A spatial micro-simulation analysis of methane emissions from Irish agricultureEcological Complexity 6:135–146.
-
87
Static Data Ageing Techniques: Accounting For Population Changes In Tax Benefit Microsimulation Models. EUROMOD Working Papers EM7/05Static Data Ageing Techniques: Accounting For Population Changes In Tax Benefit Microsimulation Models. EUROMOD Working Papers EM7/05.
-
88
Overview of INAHSIM: A Microsimulation Model for Japan. PIE/CIS Discussion PaperOverview of INAHSIM: A Microsimulation Model for Japan. PIE/CIS Discussion Paper.
- 89
-
90
A Model of the Evolution of Pensions Expenditures in BelgiumMeeting of the European HCM Network on Socio-Economic Modelling.
- 91
-
92
Longitudinal benchmarking and alignment of a dynamic microsimulation modelIMA Conference.
-
93
PRISM: Dynamic simulation of pension and retirement income. Microsimulation Techniques for Tax and Transfer AnalysisWashington, DC: The Urban Institute Press.
-
94
The Base Data for DYNAMOD-2. Technical Paper No. 20University of Canberra: National Centre for Social Economic Modelling.
-
95
DYNAMOD-2: An overview. Techincal Paper No. 19University of Canberra: National Centre for Social and Economic Modelling (NATSEM).
-
96
International Geographical Union Microsimulation Symposium2–4, MICROHUS: A Microsimulation Model for the Swedish Household Sector. A progress report, International Geographical Union Microsimulation Symposium, Stockholm, Sweden.
-
97
Behavioral modeling in micro simulation models: a survey, Working Paper No 1997:31Department of Economics, Uppsala University.
-
98
Statistical inference in micro-simulation models: incorporating external informationMathematics and computers in simulation 59:255–265.
-
99
Microsimulation for public policy: Experiences from the Swedish model SESIM, Economics and Social Research Institute Discussion Paper 242Japan: Cabinet Office, Tokyo.
-
100
Simulating the future of the Swedish babyboom generations. Working Paper No 2007:26Department of Economics, Uppsala University.
-
101
Simulating an ageing population: a microsimulation approach applied to Sweden, Contributions to Economic Analysis No 285Bingley, UK: Emerald Group Publishing.
-
102
Microsimulation and Public Policy, Contributions to Economic Analysis No 232Direct and Behavioural Effects of Income Tax Changes-Simulations with the Swedish Model Microhus, (Ed.), Microsimulation and Public Policy, Contributions to Economic Analysis No 232, Amsterdam, the Netherlands.
-
103
An Agent-based Model of Household Spending Using a Random Assignment SchemeIMA Conference.
-
104
LABORsim: An Agent-Based Microsimulation of Labour Supply–An Application to ItalyComputational Economics 27:63–88.
-
105
Retirement Choice Simulation in Household Settings with Heterogeneous Pension Plans. IZA Discussion Paper No.5866Retirement Choice Simulation in Household Settings with Heterogeneous Pension Plans. IZA Discussion Paper No.5866.
-
106
Simulating Histories within Dynamic Microsimulation ModelsInternational Journal of Microsimulation 5:52–76.
-
107
Evaluating binary alignment methods in microsimulation modelsJournal of Artificial Societies and Social Simulation.
-
108
FAMSIM Austria: Feasibility Study for A Dynamic Microsimulation Model for Projections and the Evaluation of Family Policies Based on the European Family and Fertility SurveyVienna: Austrian Institute for Family Studies.
- 109
-
110
Interim Report: Development of the pension microsimulation modelSlovenia: Institute for Economic Research.
-
111
JAMSIM: A microsimulation modelling policy toolJournal of Artificial Societies and Social Simulation 15:8.
-
112
CAPP_DYN: A Dynamic Microsimulation Model for the Italian Social Security SystemCenter for the Analysis of Public Policies (CAPP).
-
113
Dynamic microsimulation at the US Social Security administration, International Conference on Population Ageing and Health: Modelling Our Future7–12, Dynamic microsimulation at the US Social Security administration, International Conference on Population Ageing and Health: Modelling Our Future, Canberra.
-
114
Professions, entrepreneurs, employees and the new German tax (cut) reform 2000-A MICSIM microsimulation analysis of distributional impactsFFB Discussion Paper No. 34.
- 115
- 116
-
117
Assessing the Quality of DYNACAN’s Synthetically-Generated Earnings HistoriesSocial Policy Directorate, Human Resources Development Canada.
-
118
Make it so: Event alignment in dynamic microsimulation. DYNACAN paperMake it so: Event alignment in dynamic microsimulation. DYNACAN paper.
-
119
Validation of longitudinal microsimulation models: DYNACAN practices and plans. Working Paper No. 8National Centre for Social and Economic Modelling.
-
120
The modelling of institutional households by means of microsimulation1–166, WORC Report 9603.
-
121
Annual versus lifetime income redistribution by social securityJournal of Public Economics 68:223–249.
-
122
Dynamic microsimulation: A methodological surveyBrazilian Electronic Journal of Economics 4:77.
-
123
Redistribution in the Irish tax-benefit systemRedistribution in the Irish tax-benefit system, unpublished PhD, London School of Economics.
-
124
Life-Cycle Microsimulation Modelling: Constructing and Using Dynamic Microsimulation ModelsAlignment and calibration in LIAM, (Ed.), Life-Cycle Microsimulation Modelling: Constructing and Using Dynamic Microsimulation Models, LAP LAMBERT Academic Publishing.
-
125
The Life-cycle Income Analysis Model (LIAM): a study of a flexible dynamic microsimulation modelling computing frameworkInternational Journal of Microsimulation 2:16–31.
- 126
-
127
Overview of the Congressional Budget Office Long-Term (CBOLT) Policy Simulation ModelCongressional Budget Office.
-
128
A new type of socio-economic systemThe Review of Economics and Statistics 39:116–123.
- 129
- 130
-
131
Labour Market Modeling in DYNACAN–Final Report. DYNCAN Project Consulting ReportLabour Market Modeling in DYNACAN–Final Report. DYNCAN Project Consulting Report.
- 132
-
133
A Cross Country Simulation Exercise Using the DIECOFIS Corporate Tax ModelEuropean Commission IST Programme DIECOFIS, Work Package.
-
134
Multi-agent systems for the simulation of land-use and land-cover change: a reviewAnnals of the Association of American Geographers 93:314–337.
-
135
Documentation IZA?MOD: The IZA Policy SImulation MODel. IZA Discussion Paper No. 4865Documentation IZA?MOD: The IZA Policy SImulation MODel. IZA Discussion Paper No. 4865.
-
136
APPSIM-Software Selection and Data Structures. Working Paper No. 3University of Canberra: National Centre for Social and Economic Modelling (NATSEM).
-
137
How reliable are microsimulation results?:: An analysis of the role of sampling error in a UK tax-benefit modelJournal of Public Economics 53:327–365.
- 138
-
139
Reconciling household surveys and national accounts data using a cross entropy estimation methodReview of Income and Wealth 49:395–406.
-
140
Public Pensions-Canadian Analysis Based on the Lifepaths Generational Accounting Framework6th Nordic Seminar on Microsimulation Models.
-
141
UMDBS-a new tool for dynamic microsimulationJournal of Artificial Societies and Social Simulation, 5.
-
142
Poverty and income distribution in a cge-household micro-simulation model: Top-down/bottom up approach. Cahier de recherche/Working Paper 343Poverty and income distribution in a cge-household micro-simulation model: Top-down/bottom up approach. Cahier de recherche/Working Paper 343.
-
143
Model options and constraintsA computing strategy for SAGE: 1, Model options and constraints, Technical Note 2, London, ESRC-Sage Research Group.
-
144
The Use of Microsimulation Models for Pension Analysis in Japan. PIE/CIS Discussion Paper 409The Use of Microsimulation Models for Pension Analysis in Japan. PIE/CIS Discussion Paper 409.
- 145
-
146
Chapter 5 on CORSIM
-
147
Ethno-cultural diversity and educational attainment: The modeling of education in the Canadian DemoSim population projection modelIMA Conference.
-
148
Wealth accumulation and distribution: Analysis with a dynamic microsimulation modelWellington: Business and Economic Research Ltd.
-
149
EUROMOD: the tax-benefit microsimulation model for the European UnionA Harding, A Gupta, editors. Amsterdam: Elsevier.
-
150
Small area estimation using a reweighting algorithmJournal of the Royal Statistical Society: Series A (Statistics in Society) 174:931–951.
- 151
-
152
Modeling Income in the Near Term-Projections of Retirement Income Through 2020 for the 1931–60 Birth Cohorts: Final ReportUrban Institute.
-
153
Validation and policy analysis using dynamic microsimulation modelling: Evidence from experiments in the italian case. Technical reportItaly: Pisa University.
-
154
A dynamic cohort microsimulation model, Department of Economics -Working Papers No 637The University of Melbourne.
-
155
Micro simulations on the effects of ageing-related policy measuresEconomic Modelling 27:968–979.
-
156
Building a spatial microsimulation model, 11th European Colloquium on Quantitative and Theoretical GeographyBuilding a spatial microsimulation model, 11th European Colloquium on Quantitative and Theoretical Geography, Durham, U.K..
-
157
DYNASIM in comparison with other microsimulation modelsIn: G Orcutt, J Merz, H Quinke, editors. Microanalytic simulation models to support social and financial policy. North-Holland: Amsterdam. pp. 187–209.
-
158
Canada’s Population Health Model (POHEM): a tool for performing economic evaluations of cancer control interventionsEuropean Journal of Cancer 37:1797–1804.
-
159
MicMac Bridging the micro-macro gap in population forecastingDescription of the micro-simulation model (Continuous-time microsimulation), Deliverable D8 (first part), MicMac Bridging the micro-macro gap in population forecasting, NIDI, The Netherlands.
-
160
The Role of the International Journal of MicrosimulationInternational Journal of Microsimulation 1:1–2.
-
161
New frontiers in microsimulation modellingNew Frontiers in Microsimulation Modelling: Introduction, (Eds.), New frontiers in microsimulation modelling, Ashgate Publishing Limited, U.K..
-
162
Modelling within a thermodynamic framework: a footnote to Sanders (1999)Cybergeo: European Journal of Geography.
-
163
Homemaker pensions and lifetime redistributionReview of Income and Wealth 34:221–250.
- 164
-
165
New frontiers in microsimulation modellingPreface – Orcutt’s Vision 50 Years On, (Eds.), New frontiers in microsimulation modelling, Ashgate Publishing Limited, U.K..
-
166
LifePaths–Toward an integrated microanalytic framework for socio-economic statistics26th General Conference of the International Association for Research in Income and Wealth.
-
167
HealthPaths—Using health trajectories to estimate and simulate the relative importance of determinants of health-adjusted life expectancy (HALE): a statistical analysisThe Lancet 381:S148.
-
168
A spatial microsimulation model with student agentsComputers, Environment and Urban Systems 32:440–453.
-
169
Dynamic microsimulation models: a review and some lessons for SAGEThe London School of Economics, Simulating Social Policy in an Ageing Society (SAGE). Discussion Paper.
- 170
-
171
The evaluation of health policies through microsimulation methods. Health, Econometrics and Data Group (HEDG) Working Papers 10/03The evaluation of health policies through microsimulation methods. Health, Econometrics and Data Group (HEDG) Working Papers 10/03.
- 172
Article and author information
Author details
Acknowledgements
The authors wish to thank two anonymous referees, the editor of IJM, participants of the 1st, 2nd, 3rd IMA conferences and several European meetings for kindly sharing their knowledge, views and comments. For their financial support, the authors are grateful to the National Research Fund, Luxembourg.
Publication history
- Version of Record published: August 31, 2013 (version 1)
Copyright
© 2013, Li and O’Donoghue
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.