1. Methodology
  2. Labour supply and demand
  3. Firm behaviour
Download icon

Why complex, data demanding and difficult to estimate agent based models? Lessons from a decades long research program

  1. Gunnar Eliasson  Is a corresponding author
  1. Royal Institute of Technology (KTH), Sweden
Research article
Cite this article as: G. Eliasson; 2018; Why complex, data demanding and difficult to estimate agent based models? Lessons from a decades long research program; International Journal of Microsimulation; 11(1); 4-60. doi: 10.34196/ijm.00173


Questions are often raised about the economy-wide long-term consequences of micro (policy) interventions in an economy. To answer such questions, complex high dimensional, agent-based and difficult to estimate models are needed. This soon takes the economist outside the range of mathematics s/he is comfortable with. Such was, however, the ambition of the Swedish micro firm to macroeconomic systems modelling project presented in this essay, initiated almost 45 years ago. This model is presented as a Reference model for theoretical and empirical studies, with the ambition to understand the roles of the “birth, life and death” of business agents in the evolution of a self-coordinated market economy, without the help of a Walrasian central planner. Mathematical simulation is argued to be the effective tool for such theoretical and empirical analyses. Four problems have been chosen that demand a model of the Reference type to address, and that the Reference model has been used to address. They are (1) exploring the interior structures of the model for surprise analytical outcomes not previously observed, or thought of; (2) quantifying the long-term costs and benefits of large structure changing micro-interventions in the economy; (3) studying long-term historical economic systems evolutions, and asking what could have happened alternatively, if the historic evolution would have originated differently, and (4) generalizing from case observations.

1. Introducing old problems in new ways

In the wake of the Keynesian revolution, large-scale macroeconometric modelling became the big business of the economics profession. There were business cycle macro models, and input-output sector models of the Keynesian & Leontief (K&L) type driven by demand, the ultimate manifestation of which was perhaps the Brookings Model of the 1970s, managed by Prize winner Lawrence Klein. This model was eventually linked up with a collection of other national and similarly structured models to an enormous global model.

It did not take long, however, for critical comments to emerge, notably about the unclear microfoundations of such macro models, the wasteful neglect of existing microdata that came with aggregation, and in general their empirical credibility and meaningfulness. What could they really be used for?

The microsimulation approach pioneered by Orcutt (1957, 1960, 1980) was one response to this critique. Orcutt’s disapproved of the erroneous assumptions underlying macro modelling. Only under extreme and unworldly assumptions about “elemental decision-making units” would macro relationships be theoretically acceptable, but those aggregates meant “a disastrous loss of accuracy of representation”. Klevmarken (1978, 1983) also regretted the unnecessary loss of available microinformation that came with aggregation for macro modelling, and that simulation experiments on the Swedish agent-based macroeconomic model, referred to as the “Reference model” in what follows (Section 2), already at that time had obviated. This critique was reiterated in the 1977 Stockholm microsimulation conference, perhaps the first ever, where Bergmann, Eliasson, and Orcutt (1980) stated “that a criterion of good theory in economics can only be how well-grounded in relevant, empirical facts it is” (op. cit. p. 12), and the obvious fact is that economic agents such as individuals, households and business firms are different, and that the role of this heterogeneity should be recognized in good modelling. On this Citro & Hanushek (1997) argued that sufficient knowledge of micro unit behaviour (in their case households) was not yet available for accurate specification of Micro based Macro systems models. Research should, therefore, focus on obtaining better data and estimation procedures, and less on modelling based on assumptions.

Empirically well-grounded economic systems models featuring heterogeneous agents competing in dynamic markets, and growth through endogenous entry and exit (“selection”) soon run up against difficult problems of achieving statistically controlled parameter estimates. The modeller therefore often chooses to simplify the model, and instead faces the perhaps even more serious problem of mis-specification. With sufficient data and enormous future computer capacity the estimation problems of complex, selection based and non-linear models should, however, in principle be solvable. A richly parameterised model would therefore be the right reference for empirically credible and open-minded theorising (see Section 5 on Surprise Economics). Then, there would be no need for macro models at all, since the process of aggregating behaviour in markets would be endogenised within the micro-based model, and aggregation would be reduced to summing up the outputs at the end. There would even be reasons to expect that most macroeconomic relationships would not be compatible with the inherent relationships of an empirically well-grounded micro-based economic systems model (see Section 3). However, the ambition of empirical credibility may still be out of reach as of today, implying a need to state objectively how to make empirical sense of less than perfectly calibrated complex models (Eliasson, 2016, 2017a; Hansen & Heckman, 1996).

The Citro & Hanushek (1997) observation of lack of knowledge about household behaviour was even more appropriate for the state of knowledge about business firm behaviour. While the birth, the life and the death of individuals concern well-defined entities, the life of business firms is that of constant structural transformation through mergers, acquisitions and divestitures. And indeed, demand for a better understanding of the nature and roles played by business firms in long-term economic development was the chief reason for initiating the project that led up to the Reference model of this essay (Section 2). Likewise, early on questions were asked about the economy-wide, long-term consequences of micro-interventions in the economy, and prompted the quantitative inquiry into the Swedish industrial support program of the 1970s and 1980s, that was based on the Reference model (Section 6). In a historical perspective, seemingly minor occurrences in the distant past, like a clustering of successful entrepreneurial activities, or the establishment of a new institution that improved the allocative performance of markets, may have nudged the entire economic system onto a different historical trajectory than it would otherwise have taken (Section 7). The Reference model described in the next section (Section 2) has been found to be appropriate for the quantitative study of the economic systems consequences such very long-term courses of irreversible events between consequences and such.

During the more than 40 years course of the project leading up to the Reference model, we have studied how heterogeneous and quite ignorant agents (firms) compete in more or less open markets, thereby dynamically coordinating the evolution of the model economy along growth trajectories, the successful outcomes of which depend significantly on how agents are born (entrepreneurial entry) and die (exit) along the way to form more or less successful business clusters. These growth dynamics involve integrating familiar, often trivially true principles of economics. I conclude below that understanding such economic systems dynamics is not possible without understanding that market-based integration, and to do that mathematical simulation is the appropriate analytical tool. Even though simulation is a concept that has been subject to a large philosophical literature as computers have become increasingly capable (Fontana, 2006), for me mathematical simulation is a branch of mathematics that is particularly suitable for addressing complex theoretical and empirical economic systems problems.

With this paper I, therefore, start afresh from the ambitions voiced at the 1977 conference that I was myself involved in formulating: (1) one theoretical, emphasising the need for empirically well-grounded prior theory, and (2) another, concerned with the unavoidably “false” assumptions underlying macro theory (Section 3). I will ask: what kind of theoretical foundation should a relevant micro-based economic systems model stand on? How should aggregation over markets of micro behaviour be made a natural part of total economic systems dynamics? How intellectually restrictive is the economist’s standard mathematical toolbox, the calculus of optimisation? What analytical potential does simulation mathematics offer in enhancing the understanding of economic behaviour? How can existing, often diverse and taxonomically incompatible microdata be combined for maximum information access? Perhaps most important of all: what usefulness is added by those complex, analytically non-transparent and difficult to estimate micro-based economic systems models when there are so many analytically transparent and familiar partial models, the parameters of which can be readily estimated?

In the choice between well-grounded, and easy to estimate models, complexity therefore often becomes an accepted excuse to simplify the model on a “false” partial, static or linear format, resulting in an unclear mixture of inaccurate specification, badly defined behavioural parameters, and doubtful empirical credibility about what the analysis has to say.

What kind of trade-off is there between perfectly estimating the wrong model, and imperfectly estimating (“calibrating”) a Micro based Macro economic systems model, that is based on empirically well-grounded prior assumptions?

One example: Currently worries of technological mass unemployment, or “The March of the Machines” has returned in the economic debate. This time artificial intelligence (AI) causes worry (The Economist, 2016). Some 40 years ago, however, mass unemployment caused by the then new micro-electronics technologies worried even famous economists (Leontief, 1982). Since the workers destroyed the textile machines during the early industrial revolution, every half-century or so has seen technological unemployment return for debate. Since “job destruction” and “new job creation” usually occur in different industries, at different places and with a time lag, compared to the firms laying off workers because of technological advance, narrowly defined partial and static sector or macro models have little to tell on this issue. The first serious use of the Reference model occurred when the Swedish Government Committee on Computers and Electronics (DEK) asked the Industrial Institute for Economic and Social Research (IUI, now IFN), of which I had just become the director, to calculate the economy-wide long-term employment consequences under different labour market regimes, of the introduction of new microelectronic technologies (Eliasson, 1979). The conclusion was that technologically laid off labour would soon be employed elsewhere, and the socially by far most costly policy (in terms of lost output) was to prevent the introduction of new technologies and/or delay the immediate unemployment effects caused by them.

I will proceed in the next section to introduce the Reference model, a complex, evolutionary economic systems model on which the economy-wide long-term consequences of the endogenous “birth, life and death of business agents” can be studied. I will then choose four case illustrations, among many possible, the understanding of which requires such a model as a minimum, and for the study of which the Reference model has been applied. I address them in order of what I regard as important and representing great opportunities in agent-based economic modelling: (1) to evaluate the empirical credibility of “surprise outcomes” of simulations, not yet observed, or not yet thought of, because they are not subsumed within traditional and more narrowly defined partial, static, linear and/or macro models; (2) to quantify the long-term costs and benefits of large structure changing micro-interventions in the economy; (3) to study the micro origin of long-term historic evolutions of an economic system, that is addressing the question: what would have happened under alternative initial circumstances?; (4) to support generalising from case study observations.

I consider the first theoretical application especially intriguing, the upshot being that good economic theory and good models, besides being empirically credible, should comprise surprise analytical outcomes. From the beginning in 1974 the Reference model also had a dominant theoretical orientation with a strong, but novel basis in traditional economic principles. The focus was on the complex economic systems consequences of the integration of those principles, which were studied numerically using simulation mathematics. The unique dynamic properties of the Reference model originate in the integration of Schumpeterian entrepreneurial economics with the dynamics of sequential feedback of the Wicksellian/Stockholm School emphasising the difference between ex ante plans and ex post outcomes, Keynesian demand feedback of all income (wages and profits) conveyed to the household sector and taxes collected by the public sector, with a touch of Kaldorian technical change. In fact, I will argue in Section 2 that the integration of those principles in the three markets of the model is what makes up an evolutionary model.

My conclusions will also be that the use of mathematical simulation to study complex economywide dynamic agent-based economic systems theoretically and empirically is a neglected field in mainstream economics and deserves much-increased attention there.

2. The reference model economy

The Reference model has been extensively published over the years. Since recent presentations can be easily accessed, details need not be repeated here. I give a brief overview, and background on some specifics related to the four applications chosen. There are also some pertinent links to the literature of economic doctrines. Since many people have been involved in the modelling project over its soon 45-year lifespan, the reader has to excuse me for being somewhat personal at places.

2.1 Origin and background

The origin of the Reference model dates back to late 1974 when I was approached by Thomas Lindberg, then a director at IBM Sweden, who wondered why so little attention was being paid to large-scale economic modelling in Sweden and asked me to consider setting up such a model for the Swedish economy. I was at the time involved in a study on economic planning and budgeting in large western companies (published as Eliasson, 1976a) and had a pretty good idea of how to structure a model of firm decision making. My condition for engaging in such an academic modelling venture was that the model be micro firm based, explicitly representing aggregation in markets up to the macro level, and be capable of portraying the dynamics of an evolving capitalist market economy. IBM took me around the academic world to check up on what was going on in the field, visits notably reaching out from IBM’s own research centres with a social science orientation in San Jose (USA), Pisa (Italy), and Peterlee (England). One desideratum was that the model venture should not be a replication of something already achieved. There was a general agreement that this was an obvious novel approach to take. The study trips confirmed that there was no such project, excepting Barbara Bergmann’s Transactions Model of the US economy, in the research pipeline at the time. I am particularly grateful to Kenneth Arrow who helped me to get in contact with unorthodox economists in the US. Those contacts led me to Barbara Bergmann and Guy Orcutt in particular, but also to several heretic theoretical economists, among them Richard Day, Harvey Leibenstein, Herbert Simon and Sidney Winter. Winter (1964) was especially supporting in my ambition to begin building an economy wide systems model from a micro firm platform, and with a Darwinian orientation.

The deal with IBM was unlimited programming and computer support for two years. The IBM view was that computer simulation would eventually, if not soon, become the dominant mathematical tool in economics, as it was already becoming in natural sciences and engineering. I was then the head of the Economic Policy Department, and the Chief Economist of the Federation of Swedish Industries, which meant that I had a budget for statistical studies, mostly to support economic forecasting. Even though we soon realised that business cycle forecasting would not be an interesting application of this model, interest in the business community was very positive because the model, contrary to the then all pervasive macroeconomic models of academia and government, promised to confer an explicit role in the industrial and economic analysis to entrepreneurs and businesses.

The preference of the sponsors was that the model is empirically based. And I realized from the beginning that it would not be possible to secure academic funding for such a project in Sweden, so this was an opportunity not to be missed. The project so conceived was of course a reckless venture. I secured an OK from the then President of the Federation of Swedish Industries, Axel Iveroth, to proceed, and to integrate the modelling project with the business forecasting activities of my department. The University of Uppsala, and my previous professor Ragnar Bentzel, became the third party in the modelling venture.

Thanks to IBMs very effective research management practice of assigning at least one highly educated staff member on the task of being “actively interested in the project”, the IBM part of the project was successfully concluded within the two year period.1 I was especially intrigued by the ease with which I could discuss empirical relevance and technical problems of the model with IBM staff with an engineering degree. While the endogenous growth generating micro core of the model, as specified in Eliasson (1976b), has needed few modifications, the modular design of the entire model has allowed a naturally integrated extended superstructure to be built around it (see Figure 1), the monetary system being one example, later extended with an integrated stock and financial derivatives market, and a rudimentary venture capital market, as a first step towards modelling a complete innovation commercialising process, a competence bloc (Ballot, Eliasson, & Taymaz, 2006; Taymaz, 1999, and see Section 5.1).

Business Decision System – one firm quarterly expectation, planning, decision and outcome feedback cycle.

Note: The figure shows the internal expectational, decision and planning sequences, and experience feedbacks of one firm model, its interfaces with external product, labour and financial markets, and exogenous technology and global price inputs. Micro firm specification is only for four manufacturing markets. The rest of production is represented by six input output sectors, all being linked together by a constantly updated input- output delivery matrix (not shown). The eleventh public sector is shown in the figure.

Source: Updated version of figure in Eliasson (1977).

DIV: dividends.

EXP: expectations.

INV: investments.

PROFIT TARG: Profit target according to MIP targeting formula.

The Reference model described in this article is constructed from bottom up on the basis of empirical evidence on the behaviour of firms collected by myself and documented in Eliasson, (1976a), which not only provided the specification of a firm model (op. cit. Chapter XI) but also the taxonomy of the consistent Micro to Macro database needed (see Albrecht et al., 1992). To feed the Reference model with a high quality microdata foundation, my department at the Federation launched what we called the “Planning Survey” to all large Swedish manufacturing firms and some smaller ones, together covering more than 80 percent of Swedish manufacturing output. Questions were formulated to be compatible with both the firm decision model and with the taxonomy of the internal statistical systems of firms, as I had learnt and documented in Eliasson (1976a). The Planning Survey also became very useful for the Federation, and the backbone of its economic forecasting activity.

Thanks to two (one after the other) very skilled computer engineers at IBM, Mats Heiman and Gosta Olavi, the model was coded (in APL) and up and running on synthetic data already in 1975, and loaded with real firm data from the Planning Survey of the Federation of Swedish Industries in 1976. The first data set 1974–1976 was published in Virin (1976), and used to run the model for my 1977 article on the economy wide consequences of regulations and competition processes in the labour market. When I became the Director of the IUI (now IFN) in 1977 the resources of the research institute became available, and over the years several researchers at the institute have on and off worked with the Reference model and its database, among them I should mention Jim Albrecht, Ken Hanson, Thomas Lindberg, and most important Gerard Ballot, Bo Carlsson and Erol Taymaz. The model was soon ready and set up for experimental, “semi empirical” applications, and continued work would largely be supported by external funding, notably for Government committee projects. The Federation, however, continued to conduct the annual Planning Survey, for its own business cycle forecasting activity.

IBM now appears to have largely abandoned its ambitions in the social science modelling field, and micro firm based economic systems modelling has taken a long-term to catch on in academia (see Section 4). The Reference model has, however, survived thanks to a number of academic researchers that have improved upon its modular structure, and used it for empirical inquiries. Gerard Ballot, Bo Carlsson, Dan Johansson and Erol Taymaz should be particularly mentioned.

Interestingly, after the IBM period the Reference model has not had a separate budget, but has been largely self-financed through government committee work and related data gathering projects. The model has found a number of useful applications, from a study for DEK, in a joint project between IVA and IUI, financed by the Swedish Board of Technical Development (STU) (Carlsson, 1981; Carlsson, Dahmén, Grufman, Josefsson, & Örtengren, 1979), which also provided a critical dataset on global best practice technology for the model, to analytical work for the DEK (Eliasson, 1979, 1980a, 1980b, 1981), to the ambitious cost benefit study on the industrial support program that will be presented in some detail below, and to several OECD studies (Carlsson, 1991; Eliasson, 1987, 1997). For several years, IUI had three economy wide models up and running; the Reference model, one highly aggregated monetary model and a Keynes & Leontief sectoral model. Since the two last models could be derived as special cases of the Reference model by aggregating up to sector levels and shutting down all the Stockholm School ex ante plans ex post outcomes dynamics, it was interesting for the long-term analysis of the Swedish economy published in 1979 (IUI, 1979) to ask the same questions to all three models and then identify the reasons for the different answers.

The most important insight, which should not come as a surprise, was the sensitivity of long-term growth trajectories to the choice of model (read its prior assumptions). While the long-term economic systems trajectories depended critically on the parameters governing market resource allocations in the Reference model, this was not the case for the other two essentially equilibrium models (IUI, 1979, pp. 52–60).2 Another insight concerned economic systems controllability. While the Reference model economy was difficult to control through available policy parameters, simulating the other two models conveyed the illusion of being in full control of the economy. Thus, for instance, pushing the Reference model economy too fast, and too far to lower unemployment, soon began to disturb the market coordination of production and investment, and resulted in worse countervailing labour market disturbances.

Even though a de-identified firm database for the year 1982 for external academic use was made available by IUI in 1992 (see Taymaz, 1992), external academic users have not been that many. Broström (2003), who set the model up for a study of the reliability of the Capital Asset Pricing Model (CAPM) under different economic systems conditions for a master’s thesis at the University of Linkoping, however, demonstrated that the model was not that technically difficult to operate. The database work for the model, notably the Planning Survey and the complete stock and flow consistent micro-based National Accounts statistics put together for one initial year, that is 1982 (Albrecht et al., 1992), furthermore, has been found useful in other unrelated research projects. Bergholm (1985) simulated the pull effects of the small number of very large and dominant engineering firms on the Swedish economy, and its exposure to possible negative market experiences of some of these firms. Dan Johansson used the model in his doctorate thesis 2001 at the Royal Institute of Technology (KTH), which was in part a study on the exposure of the Swedish economy to information and communications technologies for the Swedish Agency for Civilian Emergency Planning. In return a new firm based computer and communications (C&C) industry was introduced in the model (see Eliasson & Johansson, 1999; Johansson, 2001, 2005). Most important, however, is the capacity of theoretical reasoning offered by the Reference model. The discussion in Section 4 illustrates that complex high dimensional models of the Reference model type constantly come up with surprise phenomena that have not before been observed, but that may occur suddenly, that cannot be derived from within the confined neoclassical structures, or ideas about what may have happened that you may go and look for. My conceptualisation of an “Experimentally Organized Economy” dawned upon me during repeated simulation studies on the model, and its foundation in Stockholm School ex ante plans, ex post outcomes analysis, featuring the prevalence of more or less mistaken decisions at the micro-level, and the general ignorance of economic actors of circumstances that may challenge their very economic existence (Eliasson, 1987, 2015). Since an eleven sector computable general equilibrium (CGE) model and a Leontief & Keynesian (L&K) model can be demonstrated (see below) to be special cases of the Reference model, any user of that model can easily relate to those more familiar models, and identify and evaluate the origin of unfamiliar surprise outcomes.

The Reference model is essentially deterministic, and features phases of deterministic economic systems chaos. We have tried to keep stochastic specifications at a minimum, even though stochastic specifications were unavoidable in two places of importance: (1) the assigning of priority order in which firms search each quarter for labour in the market, including poaching on other firms, by offering higher wages, and (2) the assignment of productivity and other characteristics of new firms entering markets as drawings from empirically studied distributions of such firms.

The Reference model began life soon 45 years ago as a bottom-up open economy construct, with locally interacting (competing) heterogeneous firms, in principle across the entire economy and over time; a complex mathematical structure beyond traditional analytical tractability. Richiardi (2017) distinguishes between such models, and the more simple, partial simulation models often related to some external equilibrium skeleton that make them analytically tractable. This essay can be seen as an argument against the latter, and for the need of the former to address a number of urgent social economic problems credibly, for instance the four examples in this document. I will also make the point that simulation is a highly sophisticated mathematical tool that today makes it unnecessary to hold on to wrongly specified models to be able to use the old toolbox of economists. The Eurace@Unibi model appears to be of the new complex agent-based kind that I advocate (see for instance Dawid, Harting, Van der Hoog, & Neugart, 2016), that also incorporates many features of the original Reference model.

The main reasons for the previous limited external academic interest in models of this type are (1) their complexity, need for new methodological skills, and demands for resources, that for a long time took such modelling beyond the budgets of academic computing, (2) their demands on unique statistical data availability, and most importantly (and unfortunately), (3) not being structurally and methodologically of the kind familiar to the profession. This has also made both replication of studies, and compact article writing on the results, difficult, even though a version of the model based on a de-identified database, was made available since the early 1990s for anyone wanting to replicate the experiments.3 Early support by IBM, the Federation of Swedish Industries, and IUI made it possible to overcome most of those difficulties. However, as I will argue extensively in the main text, and have in other publications, this is the way good empirical projects in economics should be organised, will have to be conducted in the future, and I would not do it differently, should I do it again.

2.2 Theoretical foundation

The Reference model, often referred to as the MOSES model (for MOdel of the Swedish Economic System) has been extensively documented. For technical specifications, other details and further references, see Eliasson (2017b). The following brief presentation adds some theoretical aspects in direct support of the main text of this article. I do that by demonstrating how the particular properties of the model exploited in the four applications derive directly from the integration of (1) Schumpeterian/Austrian economics focusing on the role of the entrepreneur with (2) Wicksellian/Stockholm School economics, focusing on the feedback loops between ex ante plans and ex post outcomes at the micro market level.4 All micro production and income generation is then aggregated over product, labour and financial markets with complete and consistent (3) Keynesian demand feedbacks. On top of this firms tap into an exogenous global pool of best practice technology through their investment decisions. I have called this the (4) Kaldorian connection because the original specification had technological specifications similar to those in recent “Kaldorian” agent-based models.

The Schumpeter-Wicksell connection defined the basic dynamic element of the Reference model from the beginning, and drew directly on my interview study on business planning practices (Eliasson, 1976a, 1992, 2005a). Endogenous sequential Keynesian demand feedback became a necessary element in a firm based economy wide model. The tension between ex ante plans and ex post outcomes, as emphasised by the Stockholm School, added new innovative dynamics to the traditional demand feedback, in that firms were confronted each period with their expectation errors, leading to production and investment planning “mistakes”.5

Referring to the early technology upgrading of individual firm capacities as a “Kaldorian” feature may be stretching the concept a bit. Since technology and productivity advance inspired by Kaldor (1957) has become a characteristic of a class of agent-based models (see, inter alia, Lorentz & Savona, 2007), and several chapters in Cantner, Gaffard, & Neste (2009) with features similar to those of the original version of the firm model of the Reference model, for symmetry I use that nomenclature.6

The Reference model has been implemented on firm data for four Swedish manufacturing industries/markets and placed in a consistent micro firm National Accounts L&K framework of the entire Swedish economy (Albrecht et al., 1992). My focus here will however be on the theoretical foundation of the model. Even though the model generates a large number of “stylised facts”, that capacity alone is not sufficient for empirical credibility. For calibration and empirical credibility, there is a long story of its own, see Eliasson (2016, 2017a).

2.2.1 Entrepreneurial competition, firm dynamics and endogenous growth through selection — the Schumpeterian/Austrian connection

The business firm is the source of evolutionary selection and long-term growth in the Reference model; in principle, still modelled as in the first published version of the model code in Eliasson (1976b). Each firm is being exposed to competition by all other firms in product markets, and for resources in labour and financial markets. It has to respond by investing, improving its productivity, recruiting or laying off labour, modifying its scale of operations, and from Ballot & Taymaz (1998) and on, also through endogenous learning and R&D investments into incremental or radical innovations, all to maintain its targeted profitability, or, if it fails, eventually to exit. In that process the product price, the interest rate, the wage level and employment of, and the quantity supplied by individual firms, are determined. The Ballot & Taymaz (1998, 1999) R&D based learning and innovation module is based on genetic algorithms of the kind now used in the exploding field of AI applications. With exit endogenous from the beginning, and entry since Hanson (1989) & Taymaz (1991a), the population of firms is also endogenous. The (management of the) firm does this by exercising a Maintain or Improve Profits (MIP) principle (Eliasson, 1976a, p. 236, 2017b), that involves climbing up ex ante perceived profit hills, that however change endogenously through all the profit hill climbing going on in the economy, forcing revisions in plans and in the ex ante conceptualised profit hills from quarter to quarter. In Eliasson (1976a, chapter XI) a model of firm behaviour based on the MIP principle was presented, a modified version of which has been worked into the Reference firm model. Implementing the MIP principle can be shown to correspond to ex ante profit maximising search behaviour of the individual firm, which can however never be successfully achieved ex post because of the ongoing competition, structural reorganisation and relative price change that constantly force change in firms’ perceptions of the future, and mistaken production planning, pricing and investment decisions.

Heterogeneity among firms is introduced when the model economy is loaded with Planning Survey real firm data to define the initial state for simulation experiments. Heterogeneity is maintained through investments, R&D and new technology innovations in individual firms, and innovative entry. Heterogeneous firms, living under the rules of Schumpeterian creative destruction (Table 1) lead a precarious life in the model. They constantly have to respond to actual and imagined challenges from incumbent firms or potential entrants, realistically expecting at least some to be superior performers. The individual firm simply has to innovate successfully, or its very existence may be at peril in that they may eventually be forced to exit. There is no equilibrium resting place for a firm. Thus model economy growth is pushed by endogenously enforced entrepreneurial competition based on a rationally perceived challenge that both maintains heterogeneity of the firm population, and moves a competition driven Schumpeterian creative destruction growth process among firms based on selection (firm turnover), as stylised in Table 1, see Eliasson (1996, 2009a, 2017b).

Table 1
Growth through Schumpeterian creative destruction and selection.
1. Innovative entry enforces (through competition)
2. Reorganisation
3. Rationalisation, or
4. Exit (shut down and business death)

2.2.2 Ex ante plans, ex post outcomes — the Wicksellianl Stockholm School connection

According to Ohlin (1937), the origin of Stockholm School Economics is to be found in Wicksell’s (1898) embryo of an aggregate analysis of production, Myrdal (1927) pioneering thesis on the role of expectations, and the period analysis of Lindahl (1930, 1939). Expectations, ex ante plans and ex post outcomes of individual firms constantly differ in the Reference model economy, experiences that are fed back period by period. The dynamic market coordination of the Reference model economy is regulated by a dozen time reaction parameters. Experience from mistaken expectations, and failure to realize plans, affect next period plans of firms, and so on, and critically influence the dynamics of the entire model economy. They are also the most difficult to calibrate. Measurement and calibration errors may give rise to turbulence and cumulative economic systems behaviour that has no economic foundation.

The time reaction parameters are the source of endogenous growth. They regulate the longer term reversals of the model economy that sometimes follow after a long and rapid expansion phase, when the economy has been operating close to capacity limits, when its stability is sensitive to even small disturbances (Eliasson, 1984). Because of its non-linearity and initial state dependency, the Reference model now and then enters phases of chaotic economic systems behaviour that may be difficult to distinguish from stochastic behaviour (Carleson, 1991). The flows of sequential feedback, being generated within this deterministic and highly non-linear selection-based economic system, are therefore not stochastic even though they may appear to be. I have been firmly against enforcing (on the model) a stochastic feedback flow of differences between ex ante plans and ex post outcomes, a suggestion that has frequently surfaced in academic discussions, to make the model more amenable to formal equilibrium analysis.

2.2.3 Income generation and demand feedbacks — the Keynesian connection

The economy wide perspective is achieved through a public sector that collects taxes on all wages and capital income generated in the model, and generates public consumption (Eliasson, 1980c), and a Keynesian private demand function defined as a non-linear version of a Stone-type household expenditure system that feeds back into the markets of the model, or abroad as imports.7 The initial database is stock and flow consistent from the individual micro level up to the National Accounts (NA) level, and that consistency is maintained quarter by quarter throughout the simulation. The individual firm exports some of its production if it finds that profitable. Differences in domestic (endogenous) and world market (exogenous) prices regulate imports into the markets of the model. Monetary flows across borders are regulated by differences between the endogenous domestic interest rate and the exogenous foreign rate.

A typical feature of the Reference model is expectational overshooting and longer term reversals (negative feedbacks) of strong cyclical booms and recessions occasioned, for instance, of an exogenous input of expectational, technological or policy origin. The economic reactions to the oil price shocks of the 1970s simulated on the Reference model, and global inputs of technological advance (Albrecht, 1978; Eliasson, 1978a, 1979).

Such “growth cycles” are mathematically related to the mechanisms underlying the Le Chatelier principle in, for instance, hydrodynamic systems, stating that whenever a system in equilibrium is disturbed, the system will adjust itself in such a way that the effect of the change will be reduced or moderated. In the Reference model these adjustments are occasioned by the combination of Keynesian demand, and Stockholm School expectational feedback. Determining the parameters that regulate these feedbacks is the most challenging estimation problem of the Reference model. These time reaction parameters strongly impact the economy wide dynamic cost benefit calculations discussed in Section 6 below.

2.2.4 Technological change and economic growth — the Kaldor connection

Technology has been an upper restriction of growth of the model economy, to begin with in the form of an exogenously growing global pool of “best practice technologies” that firms individually tapped into endogenously through their investments. That pool of best practice technologies was empirically studied historically by Carlsson (1981) and Carlsson et al. (1979) in a survey to the members of the Swedish Academy of Engineering Sciences. For many years the projected trends in those data were used as exogenous productivity inputs in new investment vintages, until Ballot & Taymaz (1998, 1999) endogenised firm innovative behaviour around the trend, using genetic network search algorithms that were fed by endogenous R&D investments. Firm innovation strategies could be designed to be incremental or radical8, to raise firm capacities to innovate (learning) and to discover new profitable technologies (innovation). This capacity of the firm to innovate relates to the Neo-Kaldorian branch of ABM inspired by Kaldor’s (1957) Harrod type Keynesian growth model.9 In this model technical change was related to the rate of capital accumulation and structural change (see for instance Lorentz & Savona, 2007; Cantner et al. 2009).

The integration of the modules of the Reference model is graphically pictured in Figure 1, which largely speaks for itself. The business firm module is shown, and how it interacts with all other firm modules in markets.10 The critical expectational feedback of individual firms between ex ante plans and ex post outcomes, characteristics of the Stockholm School, are pictured within the shaded rectangle to the upper right, and the Ballot & Taymaz (1998) Schumpeterian learning and innovation module, which replaced the original more primitive “Kaldorian” technology module, is indicated by arrows at the top left. The quarterly Keynesian demand feedback can be seen in the lower right hand corner. Double lined rectangles identify the three markets of the model, and the three important exogenous inputs (foreign prices, the global interest rate and global best practice technology in each industry) are underlined in their respective boxes.

Most important for the evolution of the Reference model economy is that the state space, or “opportunities space” of the model is endogenously expanding as firms explore it and discover new opportunities, what I call the Särimner proposition11, thus ensuring that the interior of the opportunities space can never be fully researched, and that firms stay for ever ignorant of possible circumstances (in the model), that may force their demise, and that the Reference model will never collapse into a “full information” static neoclassical equilibrium.

2.2.5 Market self-coordination of ignorant agents — the notion of equilibrium revisited

The Reference model is economy wide, dynamic and agent-based. Coordination of agent behaviour is endogenous through market competition, and achieved without the help of a central planner or the fictitious Walrasian auctioneer. This is achieved despite agents being grossly ignorant of circumstances that might threaten their very existence, a theme pursued in Eliasson (2017b). Market self-coordination is costly (transactions costs) notably through business mistakes, and market clearing is never achieved. The model economy still evolves endogenously through time, and if environmental circumstances are right, will do so for ever. Such self-equilibrating models not only give rise to new estimation problems, that you do not encounter in equilibrium models, but also require a different equilibrium concept than the conventional solution to an equation system.

This economy wide dynamics of the Reference model economy originates in the integration of the Schumpeterian/Austrian, Wicksellian/Stockholm School, Keynesian, and Kaldorian principles, intermediated through the three markets of the model (product, labour and financial, see Figure 1). This integration gives rise to the “Surprise Economics” examples discussed in Section 5, which also illustrate the risks of misunderstanding inherent in partial models. The point to be made is that you need all four familiar partial principles to generate such credible dynamics, and when the four are integrated in markets, they together create sufficient non-linear complexity in the form of endogenous structural change and agent selection (entry and exit) to eliminate any excuse for making the assumptions necessary to return the model onto the template of a stochastic general equilibrium (GE) model as stylised below. This unfortunately also makes the integrated model hard to estimate.12 Below the principal assumptions of a rational expectations neoclassical GE, or for that matter a dynamic stochastic general equilibrium (DSGE) model are listed (Eliasson, 1992, p. 256):

  1. Behaviour: Agents maximise expected utility – max E[U]

  2. Expectations are formed from subjective probability distributions conditioned by “all available information” (Ω), that is, historic realisations of all stochastic variables – E[X]=P(X|Ω)

  3. Agents form (from points 1 and 2) ex post probability distributions that are identical to the subjective probability distributions under point 2 – ex post P[X]≡P(X|Ω)

  4. Ex post P(X) are stationary

§ 4 is the assumption needed for statistical (“econometric”) learning, something made clear already by Haavelmo (1944).13 A steady flow of observations from the realisation of the stationary P(X) process will eventually, and with the precision desired, allow unbiased estimates of the parameters of P(X). § 3 and 4 are stochastic equilibrium conditions. § 3 hides the rational expectations type equilibrium conditions of the neoclassical, and the DSGE models, that are violated in the Reference model. This is so since (among other things) Ω ex ante is practically always ≠ Ω ex post, because of all the Schumpeterian, Stockholm School, Keynesian and Kaldorian structure-changing dynamics going on at the micro market level, making the population of firms endogenous. Hence, to be called dynamic, it should be mandatory in economic models to determine Ω endogenously and thus prevent ex post P(X) from being stationary (§4), even though Exp (X) is stationary, which has been suggested, and which is a perfectly reasonable assumption. Critical for this “anti-equilibrium” proposition are the Wicksellian/Stockholm School expectational feedbacks experienced by individual firms, a property, that together with the Särimner proposition becomes a well-defined partition between an evolutionary and a neoclassical model (Eliasson, 2017b).

Selection of agents through entrepreneurial entry competition and endogenous exit together with individual investments that will then bring in new technology in firms, and self-regulation of the model economy through agents’ competition in markets, together make the model initial state dependent, exhibiting phases of cumulative chaotic behaviour, and probably not ergodic, with the estimation problems that come with that property (Grazzini & Richiardi, 2015; Richiardi, 2013). Since the Reference model cannot be solved for an exogenous equilibrium trajectory or a final equilibrium end station, a corner stone of standard neoclassical economics has been removed. It is interesting to note from Fontana (2006, 2010) that, as this became gradually apparent at the Santa Fee Institute, the early enthusiasm among some of the founding fathers for its research ambitions in complexity economics, cooled. There is, however, no need for imposing an “assumed empirical” rational expectations equilibrium as Kydland & Prescott (1982, p. 1359) did in the “first” DSGE model. The economy wide dynamics of the Reference model is in fact normally well-behaved and self-regulated without any assumptional tricks needed, such as introducing a Walrasian central planner that does the coordination job free of charge (zero transactions cost assumption). But in order to discuss equilibrium without a Walrasian central planner, the definition of equilibrium has to be redefined, and the “GE feedback”, often lacking in partial models, will be very differently represented.

Any credible representation of an economic system has to possess some inherent equilibrating properties, but not necessarily an exogenous point or trajectory that the model can be solved for, and it is debatable whether a good economic model should be ergodic.14 A model of a self-regulated market based economic system has to be capable of dynamically operating without imploding under normal circumstances, and endogenously growing under some circumstances, without growth being propped up by an exogenous trend.

This endogenous self-regulation through supply and demand interaction in markets draws transactions costs. The most important transaction costs come in the form of “business mistakes” occasioned by discrepancies between ex ante plans and ex post outcomes at the agent level, that because of the non-linear complexity of the Reference model are unpredictable. Business mistakes so defined represent ex post outcomes that fail to be up to ex ante expectations and plans. Since entrepreneurial entry is both a growth-promoting and failure-prone activity, the rate of entrepreneurial entry (endogenous in the Reference model, but sensitive to market incentives that can be influenced by policy), and firm turnover have been demonstrated on the Reference model to be growth-promoting over the longer term up to a limit. Differences between ex ante plans and ex post outcomes are intermediated in financial markets, and therefore appear as a normal transactions cost for economic growth (Eliasson & Eliasson, 2005; Eliasson, Johansson, & Taymaz, 2005).

Clower (1967) made the lowering of transactions costs the rationale for the existence of money, as a special commodity that facilitated trade. Dahlman (1979) narrowed down the definition by specifying that the interesting transactions costs were those incurred through imperfect information, or (my point) differences between ex ante plans and ex post outcomes, that is mistaken resource allocations. This is both interesting and important in that transactions costs so delimited become unpredictable, and, as aptly noted by Dahlman (1979) both indeterminate and impossible to deal with by the traditional mathematical tools of the economist. The reason for making a point of this in the context of the Reference model is not only that such transactions costs are only tractable by mathematical simulation. They are also the important element of economic dynamics that should not be eliminated by simplifying assumptions.15 The historical and surprise economics applications of the Reference model in Sections 5 and 7 illustrate.

With his “Nirvana Fallacy” story, Demsetz (1969) had already delivered a devastating verdict on the GE model, making it a logical fallacy of using the zero transactions cost world of GE theory the reference for welfare analysis. Allowing transactions costs due to imperfect information, or for that matter ignorance (causing “business mistakes”), that are not proportional to the regular transactions costs of trading, etc., implies that the equilibrium not only becomes indeterminate, but ceases to exist, as an operating domain of the model. To study that non-linear dynamics, mathematical simulation becomes the analytical method of choice, and some measure of economic systems stability the relevant welfare concept (Eliasson, 1983, 1984, 1991a). An interesting policy exercise then becomes tuning the institutions of the model so that the time reaction parameters automatically keep the variables of the entire economy evolving along a reasonably fast growth path, but within local bands of variation that are acceptable from a welfare point of view, and not so fast as to force the economy into collapse-prone depressions every now and then. This would be a formidable simulation design to engineer, but a reasonable one, and far more reasonable than trying to place the model economy on a welfare maximising equilibrium path that does not exist.

As I will discuss below (Section 5), the self-regulatory properties of the Reference model offer excellent opportunities to study how such a welfare interesting “equilibrating” property could be meaningfully defined. From the point of view of diffusion of economic doctrines in academia it is interesting to observe that both Robert Clower and Harold Demsetz have been colleagues at the University of California at Los Angeles (UCLA), and that Carl-Johan Dahlman obtained his doctorate there. Robert Clower furthermore participated in the first 1977 microsimulation conference in Stockholm, and was generally, since then, very sympathetic to the Reference model and its dynamic properties.

All economy-wide models have to be partial in some sense, but the Reference model, integrating several well-known but partial principles of economics, should be sufficiently general to minimize awkward exogenous misspecifications that would affect the four applications I have chosen to address. The Reference model floats in a global world that is largely imposed by exogenous assumption, even though Ballot & Taymaz (2012) introduced a global model composed of cloned Reference models that trade with each other through technology diffusion. The global environment of the original Reference model was assumed “in principle” to be in static equilibrium. The exogenous variables that impact on the Reference model have been set so that the establishment of one firm in exogenous best practice technology, fetching exogenous global market prices and operating at full capacity, will earn a nominal return on its establishment (“investment”) equal to the exogenous global interest rate. In simulations over historic time (for instance for calibration purposes) we however simply collect historical data on these variables, as we also did on best practice technologies (see above). In future simulations, we project (“forecast”) the exogenous variables imposing those equilibrium assumptions.16 Hopefully those “equilibrium” constraints can be loosened up in the future, for instance using the Ballot & Taymaz (2012) extension to construct an endogenous global technology frontier for domestic firms to tap into.

For the domestic economy, the solution is more straightforward. Simulations start on a historic initial year. The model is loaded with real firm data, including prices, wage levels, profits, etc. These factual distributions across firms on rates of return, productivities, growth rates, etc., for the initial quarters are then endogenously maintained throughout simulations, one important criterion for economic systems stability being that the diversity (heterogeneity) across firms of those distributions does not deteriorate over time (Eliasson, 1984).

3. Terminology – many labels for similar apps

Microsimulation is an apt term for the ambitions I will be advocating, but the microsimulation field has unfortunately branched out in several, sometimes incompatible, directions, some of them voiced in the 1977 Stockholm conference.

The study of “micro-based dynamic economic systems theory and modelling” is my preferred general term. Simulation in the sense of this paper is a mathematical tool for the analysis of complex economic systems, in particular aimed at understanding the long-term evolution of entire economies. Microsimulation, on its side, has become a recognised term both for a method of analysis, and for the study of a particular class of economic models. The latter interpretation therefore understands microsimulation as commonly practiced to be a special branch of Micro to Macro economic systems modelling, or the wider field of economic modelling that we envisioned at the time of the 1977 Stockholm conference. That branch starts from Orcutt’s concept that each micro agent conducts a stochastic experiment, with empirical applications dominated by the study of the distributional consequences for the household sector, notably of tax changes. Market intermediated interactions between those agents are rarely modelled, if at all. Few of the large number of such microsimulation studies have exhibited an interest in the macro outcomes.

The second branch is represented by the Eliasson (1976b, 1977) micro- (firm) based self-coordinated economic systems model presented as the Reference model in the previous section, and Bergmann’s (1974) “transactions” model. Both have economy wide ambitions, as their distinguishing feature, and more importantly, they model the interaction (competition) of heterogeneous agents in explicit markets, and have a theoretical focus on the dynamics of the evolution of complex economic systems. Eliasson has often expressed his goal (for instance Eliasson, 2005b) as that of studying the economy wide consequences of “the birth, the life and the death of firms”, as they compete with each other in product markets, and for resources in labour and financial markets.

Firms are modelled to design business experiments to be tested in competition with other firms in markets, and to react to experiences from realised ex post outcomes, that diverge from ex ante plans, experiences that are fed back through markets to affect next period’s plans. Concerns about a realistic representation of firm behaviour are supported by references both to the Eliasson (1976a) study of business planning practices, as the prototype of their behaviour in the model, and to the specially designed survey to real Swedish firms to obtain a database for the model, including explicitly measured initial conditions for the quarter model simulations. The initial conditions measured are then endogenously updated from quarter to quarter.17 How aggregation of firms’ behaviour up to macro is intermediated in those markets is explicitly modelled.

The 1990s has witnessed a third branch of Micro to Macro economic systems modelling: agent-based modelling (ABM). As far as the ambition has been to model entire economic systems, for instance the Eurace model (Dawid et al., 2016), it comes close to the Bergmann (1974), Bergmann et al. (1980) and Eliasson (1976b, 1977) models. Both Ballot, Mandel, & Vignes (2015) and Richiardi (2013) classify the latter two models as the first economic ABMs, and they are right. The origin of ABM in general is however unclear, but seems not to be economics but rather computer based studies of the behaviour of ant colonies (The Economist, 2013). Fontana (2006) draws the lineage back to von Neumann, cellular automata and the Santa Fe Institute founded in 1984 to advance the understanding of complex multidisciplinary systems (Arthur, 1999), the interaction of heterogeneous micro agents in complex economic systems being one example, very much of what has been going on in the Reference model. When touching down in economics in the 1990s, ABM has been announced as a “new separate” branch of economics. The question therefore is if that literature offers more than a new name for Micro to Macro economic systems modelling published decades earlier.

In post times, Kydland and Prescott (1982) DSGE models have sailed up as a fad in academic economics, but then declined in popularity after the crisis of 2008, observes The Economist (2016, p. 65), central banks being early enthusiastic users of DSGE models. These models have been presented as both dynamic and micro-based macro compared to CGE sector models. Compared to the micro firm, or household based macro systems models, just discussed this is going a bit far, even if heralded as something radically new by many economists (for instance Fernandez-Villaverde, 2010). There are no explicit heterogeneous agents and no explicit markets (only an assumed zero transactions costs rational expectations equilibrium), and no dynamics; all markets are (in stochastic market clearing equilibrium), and when it comes to the endogenous growth cycle claimed to be there, Kydland & Prescott (1982) have plugged in an exogenous trend.18

So this family of economic macro models has little to do with neither economic dynamics nor ABM. Perhaps there is no economics at all in the DSGE model, because assumptions have been substituted for explanation. Day (1996, p. 399) therefore calls such models “statistical characterisations of their trajectories”.19 “The great recession poses a serious challenge to mainstream macro“(read DSGE models) writes Richiardi (2017). The failure of DSGE models in central banks to predict and to support an understanding of the financial crisis of 2008 seems to have caused interest in such models to cool (Goodhart, Romanidis, Tsomocos, & Shubik, 2016).20

Since both the DSGE and the CGE, as well as the K&L models can be derived as special cases of the Reference model (Eliasson 2017a, p. 362), or similarly structured agent-based models, I see no point in making this a special branch of micro-based economic systems modelling.

There is also a fourth branch of Micro to Macro economic systems models with the specific ambition of clarifying the microeconomic foundations of existing macroeconomic neoclassical and Keynesian models, taking the latter for given. That was also one ambition voiced in the 1977 Stockholm Microsimulation Conference. In the light of this paper, this ambition, however, becomes futile. With Reference type models properly established and estimated there will be no need for a separate macro theory. But some of these studies (for instance Fisher, 1972, 1983, Weintraub, 1979, 1983), are interesting for other reasons, because they clarify indirectly, and sometimes in direct words, the shaky foundations of any macro model. Fisher’s (1972) treatise on “price adjustment without an auctioneer” is interesting, not only because it clarifies that, but also because the profession had not yet in 1972, and still not, taken economics beyond the central planner and auctioneer of Walras who coordinates the economy free of charge.21 Weintraub (1983) does not hold back his words when he concludes: Could it be that the Walrasian equilibrium story has exercised such strong influence on a narrow minded profession that “empirical work, ideas and facts and falsification” have been allowed to play “no role at all”?

I will therefore stay with using “Micro to Macro economic systems modelling” as the general term that covers both microsimulation, ABM and the narrow task of clarifying the micro foundations of existing macroeconomic models as special cases. The distinction that should be made is that micro-based economic systems modelling concerns the evolution of an entire economy, featuring deterministic behaviour of heterogeneous agents interacting in markets, incompatible ex ante agent plans that are sorted out by competition and self-coordinate the economic system (without, however, clearing the markets) such that prices and quantities are determined, and realised behaviour fed back sequentially over time. Each agent thus faces the actions of all other agents as a critical part of its economic environment.

Rapid advance in computer capacity and improvements in simulation techniques have gradually made complex models of the Reference model type tractable for mathematical simulation analysis. Only recently, however, has computer capacity and databases for empirically credible estimation of such models began to become available, allowing modelling to move from the low ambition of generating “stylised facts”, by way of the very early, and for the time advanced calibration model of Taymaz (1991b), developed for the Reference model, to not yet achieved proper parameter estimation. The latter should be a priority concern to confer the empirical credibility on these models that they deserve (Eliasson, 2016; Hansen & Heckman, 1996; Richiardi, 2013). The compilation of high-quality databases on taxonomies tailored to the problems addressed probably is the most difficult of the two obstacles to progress. Ultimately, however, there should be little use for a separate branch of economics called macroeconomics.

4. What are these complex, data demanding and difficult to estimate agent-based economic systems models good for?

The question “What are these complex and difficult to estimate models good for?” is instead a fundamental concern. And it can only be answered with: “What are you interested in?”. There are a number of questions for which a meaningful answer requires the analysis to be based on an economy wide, dynamic and difficult to estimate agent-based model. However, to handle them all within the same general model structure becomes a killing proposition. Economics is a sufficiently large field to make the ambition to put together a universal theoretical construct that holds intelligible answers to all important socioeconomic questions meaningless, not to mention all psychological, sociological and historical dimensions that impinge on the economic system, and that are most often neglected altogether by economists. This is to say that economic models will always be purpose dependent, and require that the researchers present a convincing empirical argument for the prior, and thus always partial model choice they make. This does not exclude that a more general and perhaps verbal “theory” can be used to facilitate that choice, and to help interpret the results achieved on the basis of a partial model. In fact, that prior choice to arrive at an empirically credible partial model for quantitative analysis, is its most important part. It defines the “art of economic analysis” (Eliasson, 1992, 1996, 2005a, 2017b).

4.1 Good micro-based economy wide systems models make macroeconomics superfluous

To put it bluntly: Macroeconomic theory or models can never explain macroeconomic evolution, only describe it, at best (Eliasson, 2003). For an explanation you have to go down to the microlevel of behaving economic decision units and explicitly model how their behaviour in markets and hierarchies moves the evolution of the entire model economy, and then sum up (“aggregate”) the final outcomes (Eliasson, 2017b). Macro output so defined and empirically represented will then be a measure of something you desire to see, for instance a welfare index, or a quantification of available resources in an economy. When the micro foundations of heterogeneous, ignorant and behaving agents have been properly modelled and the final outputs summed up, there is no need for a separate macro theory. A separate macro theory may be needed if the micro foundations have been badly understood and erroneously represented, which Citro & Hanushek (1997) argued (from their experience with household data) would long be the case. While their conclusion was to go for improved data collection, instead of building empirically not well-grounded models that were less data demanding, I would add that good models can be built even though we do not yet have all the data needed. They may help specifying the data that needs to be collected.22 Furthermore, and as a corollary, the interesting welfare concept to study will be the stability and predictability of the economic environments of micro agents, not the maximum output per capita, or something like that, which is a concept that can neither be defined nor determined in a well formulated micro (agent) based evolutionary economic systems model of the kind I am using as Reference model (Eliasson, 1983, 2015, 2017a).

Feldstein (1982, p. 829) insisted in a much referred to article that “in practice all econometric specifications are necessarily “false” models”. There is therefore no hope that through them truth will be found. “The applied econometrician, like the theorist” continued Feldstein “soon discovers from experience that a useful model is not one that is “true” or “realistic”, but one that is parsimonious, plausible, and informative”. The question, however, still is what to mean by informative, and especially if parsimonious means wrongly specified.

Quite often a model is said “to work”. That proposition is often associated with Friedman (1953), who argued that as long as the model predicted well, its credibility should not be put in doubt, however “false” its specification. The question is what it means for a forecaster (or a decision maker who uses the forecast) to keep the model as long as “it works”, and then reject the model when it stops working, if the incident that caused the rejection is exactly what the decision maker wanted to be forewarned about? The Reference model is a particularly apt tool for responding to such questions. It exhibits long periods of seemingly steady state macro growth behaviour, during which standard, parsimonious macro models would work well predicting growth, only abruptly to break into “Surprise Behaviour” (Section 5) originating in non-linear market selection dynamics that no macro model would be capable of reproducing or forecasting. That is the kind of phenomenon a user of forecasts would like to be forewarned about, and for him to warrant the term “to work”.

Economy wide, dynamic and agent based economic systems models will normally be complex. Modelling the economic systems consequences of “the birth, the life and the death of firms” (Eliasson, 2005b), explicitly representing the interaction of competing heterogeneous agents across markets and over time, moved by innovative entry (“entrepreneurial competition”) and forced exit (“selection”), as in the Reference model, always means difficult non transparent complexity. For the life of business entities to be credibly represented “economic mistakes” in the form of deviations between ex ante plans and ex post outcomes have to be explicitly modelled as normal transactions costs (the Stockholm School connection). To warrant the term dynamic, period to period feedback from ex ante plans to ex post outcomes have to be explicitly accounted for, and since such feedbacks may be large their impact on next period investments, and production structures also have to be explicitly represented. Growth moved by entrepreneurial competition and market based selection (firm turnover) means irreversible systems evolutions and endogenously changing relative prices. Such models are non-linear, initial state dependent and exhibit phases of chaotic behaviour, as well as suffer from all the problems of parameter estimation and empirical credibility that follow. If you happen to be interested in the above dynamics, you also have to brace yourself for the consequent model complexity.

4.2 Minimum requirements of specification

Each question asked requires that a minimum of empirical properties characterise the mathematical model to make it a credible instrument of analysis, and the four problems chosen for illustration in the following four Sections 5, 6, 7 and 8 are particularly demanding in that respect. The minimum features required are not only dependent on the problem you are interested in seeing clarified, but related to the integration of competing heterogeneous, but ignorant market agents, sequential period to period market feedbacks of previous experience of agents, and because of the consequent complexity of market dynamics, endogenous structural and relative price change, causing systematic differences between ex ante agent plans and ex post outcomes (“economic mistakes”). This is a characteristic of the Reference model that is suspiciously absent from most econometric models. Such non-linear and initial state dependent agent-based models featuring endogenous populations of agents, and because of selection, irreversible economic systems trajectories, in which small, at the time minor events, may with time cumulate into major (bad or good) occurrences. These are model features that have been removed by assumption from post war neoclassical economics, in my mind to facilitate simple mathematical, but unfortunately “false” representation. These empirically relevant characteristics also unavoidably turn economic theory into a genuine empirical science, which is good. So what are the great benefits of all this added complexity and difficulties of both analysis and parameter estimation, that make them worth the effort to build and install?

Today we have better tools than were available when those concerns were formulated. Mathematical simulation of Micro to Macro economic systems models does not restrict economic theorising to narrowly and false (in most contexts) partial, static and linear models. Rich in empirical content, high dimensional models can be explored for surprise theoretical conjectures (see Section 5). The dynamics of complex interactions of agents in markets featuring sequential feedbacks of previous experiences and selection can be studied, and the consequences of endogenous changes in the population of agents accounted for. The role of initial conditions (“history”) for future systems evolutions can be studied (Section 7). An acute problem for decision makers in the business community in particular, but also frequently for the policy maker, is lack of data on the current situation. Fragmented case information may exist and the decision maker needs to form a coherent view of the economy wide dynamic implications of that information. Normally s/he has arrived at that through combining whatever personal experience there is with guesses. Generalising from case studies using a complex agent-based device like the Reference model is a systematic method of doing that, which could in principle become a new field in economics (Section 8), perhaps even for guidance in acute decisions situations, but more importantly to practice a systematic holistic approach to decision making.

The back side of the enhancement of complexity and demands on theoretical analytical capabilities is mounting estimation difficulties, and the problem that the model will be compatible with “any given” set of facts (Gabaix & Laibson, 2008). Some may say that this is a practical problem only, and Feldstein’s (1982) argument was that because of the “complexity of economic problems, and the inadequacies of economic data” all econometric models were necessarily false, and could not be explored for some therein hidden “truth”. Lacking such a model one could instead learn from “the use of several “alternative” false models” by combining knowledge, theoretical insights and judgement (op. cit. p. 283). Combining several partial, and therefore individually false models could produce a better, and less false understanding of a policy situation. But this “combination” has to be done right. While some practitioners in the economic analysis field may be in command of the necessary intuitive faculties, there is no way to tell, only to believe. Models of the Reference type, on the other hand, have been designed for a systematic combination or integration of case information, which should be a great merit.

Theoretical physicists have tried for decades to merge the four partial theories dealing with the strong, the weak, and the electromagnetic forces and with gravity, hoping to come up with a unified model of improved understanding. And with modern simulation mathematics at our disposal, the scientists do not have to hesitate because of mounting methodological complexity. The empirical credibility of such exercises of course depends on the credibility of the prior model specification and the parameter estimates. But the conjectures simulated might still suggest where to go and look for empirical verification which is very much what is being done in physical sciences. In the case of the Reference model, to make my point, this is far less costly than building the big colliders to look for the exotic “spartides” suggested to exist by even more abstract models in theoretical physics.

The large number of parameters and variables in Micro based Macro economic systems models, such as the Reference model, means that large numbers of conjectures can be generated, studied and passed empirical judgements on. And even if you as an analyst may not be ready to pick one conjectured scenario over another, you may study the originating circumstances of a number of bad outcomes, and warn your master political decision maker how s/he might guide the economy around them (see Section 7). And you do not have to disappear into empty abstractions. The Reference model of Section 2 in fact integrates the partial conclusions of both Schumpeterian, Keynesian and Kaldorean economics with the more abstract thinking of the Stockholm School economists into a mathematical structure that includes an eleven sector computable general equilibrium, or a L&K model as special cases (Eliasson, 2017a, 2017b).That is in contrast to so called pure mathematical economics, the models of which are constrained to make it possible to identify the conclusions you can draw from a minimum of trivially true axioms. Disregarding the question how economically interesting such analyses are, and can be demonstrated to be, this is not meaningful in the high dimensional model world we are discussing. A minimum of empirically credible restrictions on the parameters of the models have to be ascertained for the analytical results to be economically interesting. So the credibility problems simply have to be overcome by good measurement, new data, computer capacity and innovative advance in inference theory.

I will address this complex problem in terms of four very different theoretical and empirical problem areas, and ask what is required as a minimum of an economic model to be capable of meaningfully responding to the relevant research questions. As it happens I will be able to refer to a Reference model that both exists, is capable in principle of handling all those problems, and has been used on several, as references will show. Such conducted mathematical simulation analyses include the derivation of economy wide, dynamic economic systems evolutions based on explicitly modelled micro market behaviour, for instance the emergence, or non-emergence of a “New Economy” based on new computing and communications technologies. The following four fields of application will be addressed in turn:

Surprise economics

Theoretical exploration of richly structured, high dimensional models for economic phenomena not yet observed, or even thought of, such that the findings might serve as a guide for future empirical research.

Quantification of economy wide dynamic cost benefit studies of micro interventions in an economy: Investigating the long-term costs and benefits of large (structure changing) public projects. Such projects are often politically controversial. To convince both those in favour of, and those against a project, the analysis has to meet high standards of empirical credibility.23 Can that be at all achieved? (see Section 6).

Economic historical studies

Exploring the long run economics of feedback dynamics in high dimensional selection based models in order to obtain realistic alternative scenarios for comparison with observed historic evolutions (Section 7).

Generalising from case studies to macro

Using calibrated/estimated complex dynamic Micro based Macro models to generalize from case studies to economic systems levels. This is the other side of the previous problem. To what extent will what you have learned from a case study reflect something of more general importance? (see Section 8).

These are radically different applications that do not exhaust the analytic potential of Micro to Macro economic systems modelling, but they are very demanding on model specification and empirical credibility. I chose them because the Swedish Micro to Macro model introduced as the Reference model in Section 2 has been successfully applied in the analysis of all four. Part of the story told will be that high dimensional micro-based evolutionary systems economics are necessary to move economics forward as a science.

5. Surprise economics (theory)

Mathematical simulation today effectively frees the theoretical economist of the bounds imposed by the traditional mathematical tools of the profession, and the consequent need to simplify models for less interesting partial analysis. High dimensional complex models with many parameters and variables are rich in empirical content. To the extent the model has an economically and empirically credible foundation its behaviour can be fruitfully explored for interesting and surprising conjectures, sometimes not observed before, and more important in this context, often not before thought of, because they are not part the lower dimensional partial models commonly used. As many of the behaviours originally featured by the Reference model have been subsequently observed, and have been patched onto standard macro models as ad hoc and rarely consistent postfixes, it is legitimate to ask whether these early analytical conjectures could have served as signals of what to go and look for, without the need to learn it the hard way. One problem might have been the empirical credibility of the calibrated parameters of the complex model, and hence the relevance of those “theoretical” results. But using falsely specified, but perfectly estimated models is worse, since then you cannot use your model to identify the reasons for this or that conjecture. Given an assessment of the overall empirical credibility of the model, such conjectures might therefore serve well as warnings of what may come, to be taken as seriously as a common sense appreciation would tell. They could also help empirical researchers to go out to look for new empirical evidence. In retrospect it seems that the worries about miss-calibrated parameters were overstated compared to the risks involved in simplified, partial, and miss-specified models, although those risks are rarely made public in the vast econometric literature (Eliasson, 2016, 2017a).

5.1 Examples

Receiver competence defines the capabilities of market agents to create businesses around new technological opportunities as featured in competence bloc theory. Competence bloc theory is a sequential representation of the commercialisation process and focusses on the actors with specialist competences needed to create new innovations, commercialise them and take the winners on to industrial scale production and distribution. Early actors include entrepreneurs, who are capable of identifying the commercial opportunity of specific innovations, and industrially competent venture capitalists, who have sufficient understanding of the economic value of the opportunity to offer reasonably priced financing. They are followed by private equity investors, who open up access to the equity market, and finally by the industrialists, who takes the winner on to industrial scale production and distribution (Eliasson, 1990, 1991b, Eliasson & Eliasson, 1996, 2009; Johansson, 2007). Absorptive capacity is a related concept concerning a firm’s ability to identify, assimilate, transform, and apply valuable external knowledge (Cohen & Levinthal, 1990) that presents R&D as largely devoted to tapping into already existing available technologies. The Coen & Levinthal proposition compares with the original specification in the Reference model in which endogenous investments bring in new technology from a global technology pool (Eliasson, 1978b, pp. 65ff). Technology upgrading was partly endogenised with Ballot & Taymaz (1998, 1999). Steps in the direction of introducing competence bloc theory in the Reference model were taken in Ballot et al. (2006), who focussed on the industrial competence venture capitalists have acquired from practice. When Antonov and Trofimov (1992) installed a stock market module in the Reference model and made firm investments responsive to the market evaluation of firms to test the Eliasson (1990, p. 293) proposition that restriction on insider trading reduces the information that guides firms’ investment decisions, their simulation experiments demonstrated insider trading improved the efficiency of long run investment allocations.

The Reference models features both endogenous structural change and relative price change, with significant consequences for the allocation of resources and macroeconomic growth. Those mechanisms have been theoretically explored in several studies on the Reference model. The Eliasson, Johansson, & Taymaz (2004) study was designed to shed light on the “Solow (1987) paradox”, and the emergence or not emergence of a New Economy. With the Ballot & Taymaz (1998, 1999) learning and commercialisation algorithms turned off massive investments in R&D were not sufficient to generate increased growth. When turned on a long gestation period of no growth effects was followed by a sudden burst in macroeconomic activity that took the economy up to a higher productivity level. These experiments should illustrate how easily an economy can miss a growth opportunity if it lacks certain necessary “institutions”. The empirical credibility of those results of course rested heavily on the time reaction parameters of the model. More intriguing from a theoretical point of view where the experiments in Eliasson et al. (2005) that demonstrated the existence of a long run growth maximising rate of entrepreneurial entry and firm turnover. Above that rate the turnover of firms (read structural change) disturbed price signalling in markets and long term growth began to decline because the disturbed price signalling in markets caused an increase in mistaken production and investment decisions. The latter is a complicated dynamic property of the Reference model economy that sounds intuitively reasonable, but that to my knowledge has not previously been neither derived theoretically, nor observed empirically. Hence, those simulation experiments should prompt empirically minded researchers to “go out and look for the facts”.

A similar problem of complex evaluation and great political significance is how the global economy, or individual economies, will emerge out of the current (2018) low inflation, negative interest syndrome, or more precisely, how the current decoupling of the real and the monetary system will be sorted out by markets, or perhaps policy makers. Among the many partial propositions aired in the global economic debate one will probably be found ex post to have captured the situation. Already Wicksell (1898), the father of Stockholm School of Economics, thought about what might happen to the economy if a large positive difference between the real interest rate (the return to capital) and the “monetary” interest rate was artificially (read “by policy”) maintained for long. Wicksell’s (1898) cumulative process has mostly been associated with cumulative inflation, but some, among them Bertil Ohlin and Erik Dahmen, have argued that embodied in Wicksell’s brief, and not crystal clear writing on the cumulative process, may also be subsumed a skeleton “theory of economic growth”. The Reference model can (even if this has not been done so far) be set up for sorting out the circumstances under which either of the these two conjectures (inflation or growth) will occur in a national economy: will cumulative inflation, caused by excessive monetary expansion, be kept in check by economic growth induced by the same rate of return interest rate difference (Eliasson, 1987, p. 94, 2017b)?

None of this can be reasonably represented in a partial and static macro model. The Wicksellian cumulative process requires a model that integrates the real and the monetary markets at the micro level. To model the economic systems effects of resource reallocations intermediated by financial markets, obviously, both the real and the monetary/financial markets have to be integrated, and dynamic competition between agents, and the market feedbacks of Stockholm School individual firm ex ante plans, ex post outcomes differences explicitly represented (see Figure 1). The demands on mathematical innovation of the economist wanting to achieve this within a static equilibrium model are formidable, and the large literature attempting this has not made much progress. The point to be made here is that the Reference model has all that integration embodied, and if you are satisfied with giving up on the conventional equilibrium concept, and with using mathematical simulation a road to theoretical progress will open up. This “Surprise Economics” exemplification, in fact has wider practical ramifications.

5.2 Perhaps the economist should give up on static equilibrium?

The sacrosanct dictum of neoclassical economic theory is that a static welfare maximising and production cost minimising equilibrium is a desired ambition for the policy maker to aim for. Rules of practical policy making have almost universally been geared up to that dictum as optimal practice. So a problem of some importance is emerging if it can be demonstrated that such an equilibrium does not exist as an operating domain in a better grounded evolutionary model than the neoclassical model. A comparison between the Reference model and a standard CGE model arguing that between model and can be found in Eliasson (2015, 2017b).24

It must be noted that the CGE model can be shown to be a special case of the Reference model when aggregated up to eleven production sectors, and deprived of its Stockholm School feedbacks.

A series of policy experiments pushing the economy increasingly closer to a “static equilibrium” situation demonstrated the Reference model economy increasingly approaching collapse (Eliasson, 1991a). This can, however, only be a surprise for economists that have never thought in other terms than those of the GE model, which possesses such an equilibrium by assumption. Mathematically, the selection based and highly non-linear Reference model simply cannot be solved for such an exogenous equilibrium. When being pushed to operate increasingly closer to such a point (a not existing solution) the more destabilised the price signalling system and market coordination become, eventually forcing the Reference model economy into a singularity. For an empirically minded economist this “not existing solution” to a market coordination process should of course not be a desired ambition for policy makers. But should the theoretical neoclassical economist reject the property as such, because s/he cannot find it in the received neoclassical model, or should s/he modify the neoclassical model to have it? I think the latter, but then s/he would probably come out with a model of the same kind as the Reference model. Something like this was in fact the conclusion already of Baumol (1968, 1993), who argued that the neoclassical model would not be capable of accommodating a meaningfully defined entrepreneur, and therefore also not entrepreneurial competition. There is one further compelling reason for that conclusion.

Broström (2003) used the Reference model, then temporarily equipped with Taymaz’ (1999) market for stocks and derivatives, to evaluate the reliability of the CAPM method under different market circumstances. As I expected, he found the method to be generally unreliable in dynamic market environments, but especially so when the Reference model was operating in “close neighbourhoods of static equilibrium”, where it is assumed to work in efficient financial markets from which the CAPM method has been derived. Hence, it should come as no surprise that the 2007/08 financial market collapses in the industrial world came in the wake of an increasing use of such simplistic financial management instruments, and automated portfolio decision devices.

6. Economy wide long-term social costs and benefits of micro interventions in an economy (quantification)

Questions on the economy wide long-term social costs and benefits of micro interventions in the economy are frequently asked on both invasive and less substantial policies, and on public projects. And whatever the state of the art in empirical economics, economists are happy to provide answers. Estimates of the longer term costs and benefits based on models of the Reference type are however sensitive to the accuracy of initial state measurements, parameter determination and the specification of the policy interface.

6.1 Endogenous structural change

The Reference model offers the advantage of endogenising the long-term and structural change consequences of micro interventions in the economy. These feedbacks can however be switched off, hence allowing an assessment of whether the micro intervention is sufficiently small to support the “atomistic assumption” often used in other modelling exercises, namely that the intervention affects neither relative prices nor structures. The Reference model also features another great advantage that is exactly defined “interfaces” between the micro intervention and the agents of the markets of the model economy. The representation of real agents as artificial agents in the simulation needs abundance of microdata. The large costs of the studies required to gather it, and their unclear empirical credibility are often cited as a reason for not undertaking them. Such objections are however not convincing. The costs for a well-grounded study, even though large by academic standards, are irrelevantly small compared to the waste of resources often associated with mistaken large public projects (see the examples below). The credibility objection is in principle more relevant, but credibility is associated with how carefully conducted the study is, again a matter of costs. The study itself may also carry extra social value. Even though an agreement has not been reached on the empirical credibility of the estimated parameters, which impinge on the results obtained, specifying a relevant cost benefit model and designing a proper study of a large project require that the entire project design and implementation is thoroughly thought through. This may be sufficient to arrive at a good decision.25

6.1.1 Decisions for the long-term (dynamics)

Concerns about the economy wide long-term consequences of a micro intervention cannot credibly be based on a model that is not economy wide, and not dynamic and being run on an exogenously assumed growth trend. A relevant model should instead be based on coordination through explicit market competition among heterogeneous agents, and sequential feedback of ex ante plans, ex post market outcome differences. Such models, however, open up a spectrum of specification, measurement and estimation issues that impact on the accuracy of longer term projections. Hence, the longer term trends are rarely, as they are in the Reference model, endogenously determined. You could argue that only the short-term first order effects are of interest, because the undesired outcomes can be fixed with policy as they arrive. This represents a first and most common type of policy fallacy. If complexity prevents you (as a policy maker) from understanding what to do, and long gestation periods are required for monitoring the outcomes of your policies, it will constantly be too late to fix the problems when they are discovered. And even more seriously: the consequences of bad policies (policy mistakes) may cumulate sequentially into major events.

6.1.2 Application of the Reference model (I): the massive Swedish industrial support program of the 1970s and 1980s

The Reference model has been used to evaluate several hypothetical and realised invasive policy programs in Sweden. One fiscal reform being discussed but not realized was to replace the payroll tax with a value added tax (Eliasson, 1980c). One realised massive policy intervention was the industrial support program of the 1970s and 1980s. Regarding the latter, the IUI (now IFN) was asked by the government committee set up to make recommendations on the continuation of the program, to quantify the effects, with the explicit requirement that the Reference model was used, because of its micro foundation, its economy wide coverage and its dynamic specification. The results were published (Carlsson, 1981, 1983a, 1983b), and lead many decades later to a follow up study (Carlsson, Eliasson, & Sjöö, 2014).

This study represents an ideal example of an economy wide, long-term evaluation of a massive, structure changing intervention in an economy, but for one exception. The micro intervention was exactly represented in the model, the initial state accurately measured through a special survey to industrial firms, including those receiving subsidies (see Section 2). All the endogenous dynamics needed to simulate the economy wide long-term structure changing allocational effects were included. However, the parameters were calibrated in a rather primitive way. Thus the Reference model could provide quantitative answers in great detail to practically all sorts of questions, but their empirical credibility rested squarely on the calibrated parameters, and notably on the dozen parameters that regulated the sequential market feedback of mistaken firm decisions. More details are available in the cited studies, and in particular in Carlsson et al. (2014). The point to be made here is (1) that a complex and difficult to estimate model of the Reference model type is necessary for such program evaluations, (2) that the calibrated parameters might have been more credibly calibrated a decade later, using, for instance, Taymaz’ (1991b) calibration program, but (3) that even with the estimation/calibration techniques available today a highly critical person would probably not be satisfied. Using a more traditional model of the CGE type or a sector L&K model (several of those were made available about a decade after our study, and frequently used to address similar cost benefit problems) would however have been wrong because of misspecification, even though no one might have objected to the estimated parameters. Using such models would have meant doing away with an almost perfect micro defined policy interface, assuming away important dynamic market feedbacks (less so in a L&K sector model with Keynesian macro demand feedbacks), and eliminating by assumption all the dynamic resource reallocation effects, which in this case were negative, and large. So we faced a choice between a good model, with only roughly calibrated parameters, and an obviously miss-specified model, potentially well estimated.

In retrospect the calibrated parameters of the Reference model were probably not too bad. Recalibration using the Taymaz (1991b, 1993) calibration program, led to only minor changes, compared to the parameters obtained for the cost benefit analysis using the ad hoc manual method of Eliasson & Olavi (1978). The main results of the Carlsson et al. (2014) follow up study therefore is that realistic model specification matters importantly for dynamic long-term quantitative analysis, and that the results should have been asserted more firmly for the policy community to help stop a policy program that temporarily saved a few jobs at huge social cost. An interesting “corollary conclusion” however is that when the industrial support program was terminated, and replaced by a radically different and pro-market oriented policy agenda in 1993, the manufacturing output lost during two decades of earlier stagnation compared to the OECD average, and apparently caused by the industrial subsidy program. Swedish manufacturing swiftly responded through improved resource reallocations, and caught up with the OECD average in a few years (Eliasson, 2017a). This outcome is in keeping with the behaviour of the Reference model economy as it had responded in the alternative policies simulated for the Government Committee, the most effective policy alternative being to allow the firms in distress to die fast and support the economy at large with an equally large (as the support program) general reduction of the payroll tax. The entire restructuring back to normal growth would have been “done with” in a few years, instead of being stretched out over a 20 year period by policy at huge social costs.

6.1.3 Application of the Reference model (II): pricing of spillovers and innovative contracting

The same problem of empirical credibility comes to the fore if the supplier of a technologically advanced product subject to public procurement (for instance the Gripen combat aircraft described in Eliasson, 2010) is arguing that the value delivered “to Sweden” because of spillovers, is much greater for Swedish society than the value of the combat aircraft that the Government is procuring and willing to pay for. Such innovative contracting (Eliasson, 2017a) requires a very competent public customer, and an equally clever supplier. How to evaluate spillovers effects becomes crucial. An economic adviser to the government might argue that if the supplier would obtain a decent private return on its investment that should be enough. However, this would be an incorrect way of formulating the decision problem of the government, because if the purchase went to a foreign supplier, Sweden would have been deprived of the spillover benefits that were not understood at the time, but that have later been calculated to be significant.26 In fact, it should have been a concern of the public customer (if sufficiently competent to understand it) to set up a spillover study on its own to evaluate what the country and it citizens would get for their money (the Gripens, plus the spillovers) in the alternatives considered. Similarly, the supplier should have been even more concerned to make the external benefits (the spillovers) statistically visible to the public customer; first of all not to miss the procurement, but also to negotiate a better margin. Perhaps the government should obtain a share in the spillovers created, which was not the case with the Gripen procurement.27 Ironically, however, at the time of the Gripen decision, the Reference model was up and running, and was already being used to calculate the economy wide costs and benefits of the enormous industrial subsidy program mentioned above. Both the consortium of firms responsible for the development of the Gripen, and most subcontractors were represented as real firms in the model, had spillovers been a recognised phenomenon in the policy debate surrounded the Gripen project. A full scale cost benefit study of the Gripen project on the Reference model therefore would not have been all that difficult, and definitely not costly, compared to the economic size of the procurement, and the risk of lost social benefits (spillovers), had the contract gone to a foreign supplier.

To demonstrate the potential of the Reference model to make the spillover benefits of large public procurement projects “statistically visible”, to serve as a platform for “innovative contracting” in public procurement, the ex ante cost benefit analysis that should have been done in 1980 was partly carried out ex post in Eliasson (2010). Spillover cases were identified and gross spillover values calculated. The database of the Reference model was used to determine opportunity costs manually approximating the endogenous market adjustments occurring in the Reference model. The case analyses added up to very large spillovers from the Gripen project net of opportunity costs. Calculated spillovers in fact amounted to at least 2.6 times the actual development investment, raising questions of credibility. Fortunately a large new growth theory based econometric spillover literature, notably Jones & Williams (1998), appeared to strongly support the numbers from my case study. Eliasson (2017a) therefore develops a method to interpret these “surprisingly large” spillover measures in terms of the dynamics of the Reference model, notably by assessing the biases that might have crept into the estimates from not using a properly calibrated Reference model to endogenously determine opportunity costs. Above all, however, since the Reference model explicitly integrates the case study method with an economy wide dynamic agent-based model (see Section 8 on generalising from case studies) it could be used to explicitly relate the case study results to estimates obtained in a large number of econometric spillover studies based on macro or sector models. Since those models were special cases of the Reference model, the comparison was quite straightforward. The partial econometric results could be directly evaluated in terms of what would have been the result of full scale application of the Reference model, and then compared to the actual case study results.

The problem of good specification and credible parameter estimation becomes acute when comparing the economy wide long-term consequences of the large and structure changing Gripen combat fighter procurement (Eliasson, 2010), with the much smaller weapons development programs for which “atomistic assumptions” are reasonable. Here the composition of spillovers are different, being dominated by unplanned for exports28, rather than new civilian product technologies, as in the Gripen case, and a larger share of new civilian business formation based on the military technologies (Eliasson, 2017a).

6.2 Other examples that demand well-grounded model specifications

Other examples of the practical use of complex simulation models can be mentioned. After the worst air accident ever, when a KLM and a Pan Am Boeing 747 collided on a foggy runway in Tenerife in 1977, the two parties in court used complex computer models that represented the cause of the accident to determine responsibility, and how costs should be shared. Since each party in the trial came up with its own model, the assumptions underlying each specification presumably had to be well understood by both parties, including the setting of parameters. The demand on computer modelling competence on both parties, including their abilities to communicate what they were saying to the judges of the court, hence must have been extremely large, far larger than what we are demanding of economists calculating spillover benefits.

Calculations of insurance risk premia, including the risk of “close catastrophes” or hypothesised losses from “near misses” provides another example. The normal procedure used by insurers is to calculate the risks based on actually occurred accidents. Counterfactual “what if’ calculations of risks that almost occurred requires a much more sophisticated model, explicitly incorporating the probability that the events under consideration might have happened, rather than using hard data on what actually happened in the past. Since we do not have data on what has not happened, we are in the business of making prior assumptions about, for instance, what the total loss would have been if hurricane Irma in 2017 had hit Miami instead of the less populated areas in Florida and Cuba. For such calculations a more complex weather model than those normally used would have to be integrated with the ex post risk calculations (The Economist, 2017, p. 73).

6.3 Summing up

Economy wide long-term cost benefit studies of micro interventions in the economy are perhaps the most useful quantitative applications of agent-based economic systems models like the Reference model. In such applications empirical credibility matters critically to negotiating parties, and the Reference model is sufficiently high dimensional and flexible in specification to facilitate an agreement between two competent negotiating partners.

7. Economic historical studies

Economic historians should happily recognise the potential of high dimensional models with many parameters and variables and sequential market feedbacks, which embody a rich variety of possible historical evolutions of the model economy. Their scientific task has normally been limited to describing ex post the one track historical evolution has in fact followed. To explain why the economy embarked upon a particular track, however, requires an analysis of what alternative histories could have occurred. Identifying the origin of alternative economy wide historic developments furthermore requires that you take the analysis down to the market/agent level. Depending on the initial conditions (a problem of historic measurement), and the parameters of the model that guide the historic evolution (a matter of relevant specification and estimation), something entirely different might have occurred. This defines the difference between measurement without context and historic explanation, which requires a comparison of facts with alternative possibilities. For the latter the historian needs a model capable of generating credible alternative economic historical evolutions.29

There are of course problems associated with attempts to be up to such ambitions. What, for instance, does it mean for understanding and predicting over the longer term that the agents (firms) that dominate the economy today are likely to have been a seemingly insignificant market choice of innovators in the past, a choice that could in no way have been reliably predicted at the time? How should the very long time and bad future consequences of bad policy choices today, that can be discounted away (the political discount rate), be compared with the distress experienced by later generations, when the bad future has materialised? Evolutionary, micro-based economic systems models that are empirically well founded exhibit these properties. None of these historical questions furthermore can be meaningfully raised without the explicit context of such a model. Even though a tall order for the economic historian, complementing the analysis of ex post facts with simulated alternative economic histories should amplify the empirical credibility of the historical analysis. The Reference model of this article can simulate such alternative trajectories in great detail, and their long-term evolution is not, as in neoclassical growth models, governed by an exogenously imposed (assumed) equilibrium trend.30 Should we engage in such number crunching? I think we should, even though there are problems.

First, growth of the Reference model economy is controlled by the most difficult to estimate time reaction parameters, and competition based selection through entrepreneurial entry and exit sometimes makes small circumstances cumulate into major future events. But this is, as we have already discussed, also a typical historical fact, in that what we observe today is almost always the result of historical circumstances that were at the time seemingly insignificant, often produced by chance. Hence, the simulation of alternative histories should be based on models that feature the cumulative importance of such historic choices. For instance, why have some regions, or entire economies, failed to be industrialised, while others have grown successfully for centuries, only to sometimes suddenly collapse and retard into a less advanced state? Literature abounds with alternative historical speculations of historical development, and models of the Reference type would allow evaluating these speculations in a logically consistent way. However, over the longer term, and for the same reason, the economic consequences of small errors in estimated parameters and measured initial conditions may cumulate into significant errors.

Second, rather than providing counterfactual histories for the past, simulations can also project the present into the future. This can be a valuable guide for policy makers. Bad outcomes today can be the consequence of bad policies in the past, but the complexity of the economic evolution might prevent policy makers from making sense of it and take appropriate action. Moreover, even when policy makers think they know, correcting the situation through policy may take more time than the political horizon: having a Reference model can help extending such a political horizon. However, forecasts to guide the model economy onto a desired long-term growth path may be impossible because of the immense number of future paths the model economy can take, the near impossibility to simulating them all to make an informed policy choice, and (above all) the bad empirical control of the calibrated parameters. This implies large risks of substantial policy mistakes, if a particular simulated forecast is taken seriously. Device policies that work “on average” will not solve that dilemma. Sensitivity analysis of the calibrated parameters (as in Eliasson & Taymaz, 2000) will indicate the risks associated with a particular policy choice, though.

An interesting and potentially socially valuable application however exists. The potential of the kind of models we discuss, including the Reference model, is to be capable of generating many different economic systems histories. For each of them it is possible to trace ex post and in great detail, as economic historians do, their origin and the details of the historic path the economic system has taken. While trying to police the model economy towards desired long-term outcomes is both futile, and involves significant risk of taking the economy in the wrong direction, trying to avoid bad future outcomes by steering around circumstances that create them makes more sense. In principle, it is possible to explore by simulation a large portion of the near term interior of the economic opportunities space of the model31, and to determine circumstantial risk zones that policy makers should try to stay out of to prevent bad long-term outcomes. However, how much credibility should be attached to those calculated risk zones is again a matter of empirical credibility of the model used: (1) its prior specification, (2) the empirical credibility of its parameterisation, on which it might not be possible to reach consensus, and (3), not least important, the quality of measurement of initial conditions. On all three counts policy makers will have to apply both common sense and sound judgement. This second use of the model to help device risk reduction policies, as distinct from forecasting, should however require less in the form of empirically accurate parameterisation. The risk of missing a specific predicted policy target because of errors in parameters, must be larger than that of misguiding the economy with the help of the same model around a simulated undesired event. An analogy could be trying to bring an old car with a loose steering, driven at high speed on a narrow and winding road, to a simulated (“predicted”) Nirvana. That must involve a larger risk of failure than changing the road, if the model suggests the road leads to disaster.

8. Generalising from case studies to macro

Case observations may be complemented with data on their environmental context (for instance an economy wide model) for an improved understanding of what the case observations mean for the entire economy. Ideally the cases can be entered as exogenous interventions in the markets of the calibrated Reference model, as in the industrial support program of Section 6. Eliasson (1984) also simulates the catastrophic macroeconomic outcome of a single microeconomic event, triggered endogenously by an unhappy constellation of market circumstances, and the economy wide dynamic feedback consequences. Even if the model has not been “credibly calibrated” for such experiments and the ambition is to quantify the macroeconomic circumstances of certain micro interventions in the economy, the logical structure of the Reference model and its database can still be used to validate case study results against external information, as in the Gripen spillover measurements in Eliasson (2010, 2017a), briefly presented in the cost benefit Section 6.

Generalising from case studies to the economy wide level on the basis of an economy wide agent-based model also offers a number of practical opportunities for learning of both business decision makers and policy makers, and theoretical insights for the analyst.

8.1 Business decisions in an economy wide dynamic firm based model

To make sense case observations practically always have to be related to a wider context than the case itself. Such generalisation is commonly practiced in business decision making in that decisions simply have to be taken on scant and unreliable evidence long before the environmental circumstances are understood, to prevent the business from being overrun by competitors that have taken the right decisions faster. Experience and observations are then filtered into an “intuitively understood” decision model of an individual, a group of individuals, or a firm (a “competent team”) based on the ad hoc experiences of business decision makers. Knight (1921) made a rational case for such behaviour in arguing that the business decision maker used his own decision model, however conceived, to turn genuine uncertainty into subjectively calculable risks (Eliasson, 1990, 1992, 2005a; LeRoy & Singell, 1987). This behaviour can also be demonstrated to be rational in the Reference model, both for the business decision maker, and socially, because (1) innovative entrepreneurial decisions by definition cannot be objectively founded, and (2) that if intuitively well-grounded decisions are delayed on the belief that they will be better understood when more evidence has been collected, they may still be both misunderstood, and taken too late. Since (3) entrepreneurial ventures both succeed and fail, an interesting question is whether the expected outcomes are positive, and whether the business failures can be regarded as a necessary cost to incur for economic development to occur (Eliasson & Eliasson, 2005). A corollary question is under what institutional circumstances a free experimental trial and error process will have a positive long run outcome in expectation. On this Antonov & Trofimov (1993) demonstrated on the Reference model that forcing all agents in the model economy onto a centralised planning mode (a “centralised forecast”) was not the optimal policy in the evolutionary and unpredictable economic environment of the Reference model, with constantly changing and unpredictable structures. Allowing each agent to form individually conceived views of the future, and designing their business experiments accordingly, meant that agents stumbled onto successful innovative action that would have gone missing for ever in the irreversible evolutionary environment of the Reference model.32 The number of failed business experiments increased as well as firm exits, but the long run macro growth outcome was larger than in the centrally mandated policy experiments. This better long run outcome was thus achieved at the social cost of more mistaken business decisions (firm exits), a result repeated on a later version of the Reference model in Eliasson et al. (2005). Paradoxically, therefore, even grossly ignorant agent decisions may together coordinate the entire Reference model economy towards a long-term outcome that is better than what a central planner or Walrasian auctioneer can achieve. The reason is that the information base for centrally guiding the Reference model successfully (even knowing its code), on the basis of data generated by the model, to an optimal and better outcome does not exist. This result derives directly from the Wicksellian/Stockholm School features of the model. In the Reference model, firms make their own autonomous decisions, discovering opportunities which the policy maker or central planner, relying on the limited or distorted information available at central levels, cannot see, or which the central planner, by imposing its decisions, can prevent them from exploiting. The theoretical conjecture is that the same thing might also occur in a real economy, and the scientific conclusion is that you need a complex economy wide, dynamic and agent-based model of the Reference model type both to understand, demonstrate and explain it.

Moreover, for large structure changing “political projects”, even small risks of disastrous long run outcomes make decisions at central policy levels not only irrational, but outright dangerous for the entire economy. Forcing all actors to accord with one single master plan for the model economy is an example of this, because even if such a master plan may by pure chance come out right for some time it may also be entirely wrong, and possibly disastrous. Large political projects may however be tested on the Reference model under various assumptions for the policy maker to get a “feel for” the possible outcomes, and then for bad and disastrous outcomes in particular. The argument under historical studies in Section 7 was that trying to guide the Reference model (and afortiori the real economy) towards a Nirvana outcome through radical policies is hardly possible. Using the Reference model to be alerted of the bad or disastrous very long run side effects of bad policy should however be possible, and therefore avoiding them as well. But one more significant conclusion can be drawn.

8.2 Why not staff the real firms of the Reference model with its own managers to both enhance structural learning and improve parameter calibration?

The behaviour of real individual firms in the Reference model influences the macro economy. If the behaviour of individual real agents (“case studies”) can be assumed to be representative for other agents that same behaviour may be transferred to them, by assumption or statistical investigation. This is a scientifically more acceptable procedure than to assume a particular theoretical model to be “correct” in an empirical application. The credibility of such procedures however still rests on the credibility of the specification and parameterisation of the model.

The ultimate benefit of the Reference model has been to make full use of its representation of short-term budgeting and long run planning processes (as researched in Eliasson (1976a) and implemented in the model) to link up with real firm managers in charge of budgeting and planning and ask them to run their own model firm by loading it with their own data33, setting their own parameters, and even improve upon the specification of their own firm model, hence in effect help calibrate parts of the model. This would be a structured (by the Reference model) case of experimental economics placing live actors in an economy wide model economy. In addition, “staffing” the real model firms with managers from the corresponding real firms could be an alternative way of studying how the economy at large would respond, for instance to policies. This would be the ultimate method to achieve empirical credibility of model predictions, and it was in fact a private ambition of mine when I was the head of the economic policy department of the Federation of Industries, that was one of the three founding partners of the project that led up to the Reference model.

To conclude on the potential use of the Reference model to generalise from case observations, the model was in fact designed from the beginning to be used as a large scale business game simulator to train managers, offering the unique capacity of allowing “real life competition” between the “trainees”. A business manager would then be able to simulate the consequences for both his individual firm, and for the economy at large of particular actions under different assumptions of how other firms would react. One example of that was the widespread worry in 1975 of what the first “oil price crisis” would do to both the economy and an individual firm, on which the model would have immediate and precise answers, even though it was used much too early for such an exercise (Eliasson 2017a, p. 295). Preparations to use the Reference model for such interactive simulation experiments also began early. Two divisions of Volvo, represented in the model, were set up to be operated by Volvo staff. In the late 1970s, even large mainframe computers were however not capable to handle such games on the Reference model. When this management experiment was conducted at the IBM computer centre in Stockholm in the late 1970s three mainframe computers were needed, one each for running the Volvo divisions, and one for running the rest of the model, including the interaction with the division models (Eliasson, 1985, p. 151). When sufficient computer capacity became available in the 1990s on PCs the focus of the model team had, perhaps unfortunately, been directed elsewhere.

8.3 Explanation versus description

It would hardly be convincing to argue that the real economy is linear, but a common belief has it that linear model approximations will still do. Before computers and simulation mathematics became available, linear economics simply had to do, but that attitude appears to linger on. Stochastic linear process models are still popular simulation devices, and the observational equivalence of data generated between a deterministic non-linear model, a macroeconomic linear stochastic process model and reality makes it difficult to distinguish statistically between them. This makes many feel at home with simple transparent models that can generate some stylised facts of reality. Why bother with complexity when transparent linear models tell the same thing? On this Day (1996, p. 400) concludes with a resounding “no”. Linear stochastic macro models tell nothing about the underlying dynamics that has generated a stylised descriptive, for instance, macro outcome. To be explained and understood, the analyst has to dig into the underlying micro processes (Eliasson, 2003). Day invokes the “Lucas critique” (1976) to support his position, and I can only agree. The structural dynamics that characterises an evolutionary economic systems model can be demonstrated to originate in the non-linear selection based interactions of heterogeneous agents, innovating and competing in markets and attempting to realise largely incompatible plans. This behaviour ultimately rests on the integration of Schumpeterian entrepreneurship, Wicksellian/Stockholm School of expectational feedback, Keynesian demand feedback, and Kaldorian technology, in a Lindahl (1930) recursive economic systems scheme (see Section 2).

9. Conclusions

This paper is an argument against excessive parsimony in economic modelling, with the added notice that when you have to cut modelling complexity down, which you always have to, the partialisation arrived at should be argued credibly on empirical grounds, and with reference to the problem being addressed. Since modern mathematical simulation technology has done away with the need for unnecessarily cutting down on complexity to achieve theoretical clarity, there is no insight to be gained from using partial and static macro models to address economy wide long run problems, or linear models to address non-linear phenomena, or macro models to answer questions about the economy wide consequences of micro interventions in an economy.

Economists had to use such misspecifications in the pre-digital age. If they still stick to such practices they have become the prisoners of the old toolbox of the profession. I have gone through four problem areas where large scale economy wide and long run (dynamic) micro agent-based economic systems models are needed to answer a number of commonly asked “what if” questions, and listed the minimum requirement on specification to avoid giving erroneous answers. Empirical credibility of both prior model specification, and estimation has been a key notion.



This is not entirely correct. The original specification of the model did not include an integrated monetary or financial sector, which IBM deemed desirable and extended the two year period by a quarter of a year. One problem was that a five year simulation by quarter with the Reference model populated with some 90 firms required the capacity of IBMs largest computer system in Europe, which was made available to us during the night. Because of the horrendous demands of the model of computer capacity, this additional quarter of computer support became a critical respite. During that time I had become the director of the Industrial Institute for Economic and Social Research (IUI, now IFN), and Jim Albrecht, visiting from Columbia University, managed to get the APL code of the Reference model translated from IBM APL to DEC APL, using a translation program developed at Columbia University, and all of a sudden we could transfer the Reference model to a DEC mainframe that the Institute of Industrial Economics (NØI) in Bergen, Norway made available to us for free during nights. In a couple of years a Prime minicomputer installed at the Federation of Swedish Industries had the capacity to deal with the Reference model, and in 1989 Erol Taymaz arrived at the IUI from Case Western Reserve University, where he had just received his doctorate in economics, and solved all computing and simulation hurdles of the Reference model by transferring it to a PC.


Also see Eliasson (2009b).


See Taymaz (1992). The Planning Survey of the Federation of Swedish Industries included confidential data.


For those not familiar with Stockholm School economics, see Jonung (1991), and in Swedish Palander (1941). It should however be noted that the Stockholm School economists never attempted to take their analysis down to the agent/market level, and to tie their analysis together into an economy wide dynamic systems theory. For my particular interpretation in the context of the Reference model, see Eliasson (2015).


I use the term “mistakes” for such ex ante plans, ex post outcomes deviations of firm decisions as a generalisation of von Hayek’s (1935) discussion of “malinvestments”, in that each firm/agent operates according to a “realisation function”, a term introduced in Modigliani and Cohen (1961), who significantly did not acknowledge any influence nor awareness of the Stockholm School. This captures the consequences for next period decisions of mistaken decisions in the previous period, something I studied empirically on Swedish investment data in my doctorate thesis (Eliasson, 1967, 1969).


This was pointed out by a referee of Carlsson et al. (2014), see Section 6. Since Ballot & Taymaz (1998) there is however much more to the technology innovation module of the firm model, in that the firm model was then equipped with an endogenous genetic learning and innovation module.


A modified version of the linear consumption system estimated by Klevmarken & Dahlman (1971).


the firm model can be exogenously characterised as having a management inclined to be incrementally or radically minded. Similarly, in the example in “experimental economics” mentioned in Section 8, real managers could themselves decide which behaviour to adopt.


Even though we were not aware of that literature until it was pointed out by a referee of Carlsson et al. (2014).


And with the rest of the model economy represented as an eleven sector Keynes & Leontief (K&L) model (not shown in the Figure).


the Särimner proposition states that the state space or opportunities space of the Reference model, or what I call the Experimentally Organized Economy, expands at a faster rate than it is being explored, thus keeping the agents of the model for ever ignorant of circumstances that will now and then even challenge their very existence (Eliasson, 1987. p. 29, 1991a, 1992, 1996, p. 26, 2017b). The Särimner feature is an empirical proposition. If not upheld agent learning through exploring the state space will eventually make the state space of the model fully mapped out (transparent), and model dynamics will collapse into a state of static full information equilibrium (Eliasson, 2009a). Firm learning from exploration also expands the state space, but if learning through exploration and competition becomes too fast, structures change and disturbs the price system such that transactions costs in the form of business mistakes escalate (Eliasson et al., 2005) and prevent the opportunities space from being fully explored at any point in time. The empirical proposition is that the opportunities space grows faster (through exploration and learning) than it is being explored, thus keeping the agents in the economy in a constant state of ignorance. It may even be the case that we are all becoming less and less knowledgeable of all that can be learnt about. Särimner was the pig in the Viking sagas that was eaten for supper in Valhalla, only to come back next morning to be eaten again in the evening, and so on. The difference is that in economics we face a positive sum game, in that the state space of the Experimentally Organized Economy grows from being explored.


I say “hard” because the conclusion in Eliasson (2016) was that given today’s computing capacity, as distinct from what was available only a decade ago, it should have been possible today to “reasonably” estimate the Reference model used for the cost benefit analyses of the Swedish industrial support program of the 1970s and 1980s presented in Section 6. The irony of the situation is that most of, perhaps all the data needed for such a full scale estimation, including individual agent panel data, were available at the time. Today the academic costs of such an estimation project would have been a negligible fraction of the output lost in the industrial support program. In fact, most of the data may still be available electronically.


See also Lindh (1993) and Bray (1982).


Even though Samuelson (1968) appears to be of that opinion. I would rather argue that an evolutionary model should not, even though a design that makes all model scenarios converge onto the same trajectory in the very long historic run, could be a reasonable a priori approximation compared to the neoclassical steady state models. For the time being we know that the Reference model cannot be solved for an exogenous steady state, but for the current version of the model we are not sure about ergodicity. A very large number of 200 or 300 year simulations might however tell. And both the surprise economics Section 5 and Section 7 on historic evolutionary simulations relate to this question.


That transactions costs as the consequence of disturbed market pricing caused by inflation and lowering the predictive power of price signals affect economic growth negatively was demonstrated on the Reference model already in Eliasson (1978a). To avoid the mathematical problems of “transactions costs” economist have sometimes assumed that they are proportional to production costs, or a fixed cost independent of the amount transacted. Such assumptions, however, makes transactions costs indistinguishable from the regular costs of production, Dahlman points out (op. cit. page 145), and thereby of no analytical interest. Diamond (1984) makes exactly that assumption.


The most detailed description of how that is done can be found in (Eliasson, 1983, p. 313).


This is only partly correct, since there was no way to obtain a research budget for such a large survey. It had to be motivated by other uses, and the prime use was as a forecasting support, and an instrument for being in contact with the firms for the Economic Policy Department of the Federation of Swedish Industries, which was at the time headed by the author of this article. The great benefit for modelling work was first that the questions to the firms could be structured to fit their own internal databases, as understood from the Eliasson (1976a) interview study. But (second), the constant interaction with decision makers in firms was also a great advantage during the early specification phase of the model. This Planning Survey to firms was first published in Virin (1976).


Or the US growth rate 1950 – 1979, assumed to be such an exogenous stochastic equilibrium growth path, around which they calculate fluctuations assumed to be independent of that same growth trend (op. cit. p. 1359).


Also see Eliasson (2017a, section 13.6.12).


And oral statements by colleagues in the financial community.


That is at zero transactions costs. Cf Clower on the existence of money in the previous section, and the intriguing argument that the only true transactions costs are the economy wide consequences of unpredictable differences between agents’ ex ante plans and ex post outcomes.


The Reference model of this paper was specified before data collection began on the basis of interviews conducted with firms (Eliasson 1976a). The “needs” of the model then determined questions asked in the separate Planning Survey to firms conducted by the Federation of Swedish Industries. See Section 2 above.


Including sufficient objectivity to prevent the capture of the method of calculation of vested interests (Button & Eklund, 2017).


Demsetz (1969) argued the same thing, but he did not have a Reference to compare with.


Another reason for not undertaking proper cost benefit studies may of course be that the promoters do not like to be frustrated by objections.


How to calculate the spillovers effects is a tricky problem that I discuss further in (Eliasson, 2017a). To begin with, one has to decide on what alternative to compare with, given the fact that a new combat aircraft is needed. In the Gripen decision, formally taken in 1982 between the Government military procurement agency FMV and the IG JAS consortium headed by Saab, spillovers were not part of the negotiations. With the IG JAS consortium willing to cover the technical risks, indigenous development of an entirely new design and a foreign purchase came out roughly even, so the IG JAS consortium fortunately was awarded the contract. Had spillovers been recognized in the negotiations, the decision would have been clearly in favour of the Gripen as a Swedish project. For previous procurements of combat aircraft during the cold war, all being indigenous projects, the “tradition” was to allow for a margin for the supplier justified by innovative technological developments, and some coverage of technological risks. In the political debate this “generosity” towards the supplier was, however, often referred to as waste, or even as corrupt practices.


The fact that the indigenous development of the Gripen was at all undertaken and came out both on par with or above specifications, and below budgeted costs of course depended critically on the technological capacities of the IG JAS consortium to do it, and that the consortium agreed to carry the technological risks, which provided strong incentives to control for such risk, and hence costs.


that technically show up as spillovers in the macro econometric studies (Eliasson, 2017a, chapter 5).


The Malerba, Nelson, Orsengio, & Winter (1999) paper was the first in a series of “history friendly modelling” papers on industry evolutions by the group. Even though the rubric might suggest otherwise, these studies appear not to be economy wide and evolutionary dynamic in the sense of this section. They rather seem to address exogenous micro occurrences in partial industry models that lack the economy wide feedbacks that I argue matter importantly in the very long run, witness for instance the New Economy simulations, and the firm turnover study in Eliasson et al. (2004, 2005). Those studies rather belong to Section 8 on how to draw empirically interesting general (for instance macro) conclusions from case studies or partial models.


Just a note in passing. The Kydland and Prescott’s, (1982) famous real business cycle article which defines the core of the Dynamic Stochastic General Equilibrium (DSGE) models widely used by central bankers across the world, was set up on such an assumption. Even though heralded as a model that explained an endogenous growth cycle, the growth trend was in practice exogenously imposed. K&P assumed the 108 quarters of US growth 1950 – 1979 to be a rational expectations exogenous equilibrium steady state, that was independent on the fluctuations around it, or as they expressed it, was not “inconsistent with relevant micro observations” (see op. cit. p. 1359). By assuming that, the number of parameters that had to be calibrated was drastically reduced. Since such a rational expectations equilibrium probably does not exist in the Reference model, such a calibration method would not work for the Reference model.


not the entire opportunities space. See the Särimner proposition in endnote 11: such interventions to stay clear of a bad future scenario create a new future scenario, which might also be bad, and so on.


This could be seen as an example of Kirzner’s (1997) discoverer entrepreneur that contrary to Schumpeter’s disturber entrepreneur, discovers profit opportunities. In the version of the Reference model that Antonov and Trofimov (1993) used, discovery was simply a matter of the financial market filtering out of successful (ex post profitable) business experiments, and forcing others down or out (exit). After the innovation and learning modules of Ballot & Taymaz (1998, 1999) had been installed, entrepreneurship is both Kirznerian, in that new business entrants act on expected market profit opportunities and learn how to improve in whatever they are doing, and Schumpeterian, in that entering businesses exercise a disturbing competitive challenge to incumbents, constantly forcing them to improve, and some to exit (Eliasson, 2017b). See Table 1.


which is in fact already done for the real firms in the database of the Reference model.


  1. 1
    A Micro to Macro Model of the Swedish Economy. Conference Reports, 1978:1
    1. JW Albrecht
    Expectations, cyclical fluctuations and growth – Experiments on the Swedish Model, A Micro to Macro Model of the Swedish Economy. Conference Reports, 1978:1, IUI.
  2. 2
    MOSES Database (Research Report No. 40)
    1. JW Albrecht
    2. P Braunerhjelm
    3. G Eliasson
    4. J Nilsson
    5. T Nordström
    6. E Taymaz
    Stockholm: IUI.
  3. 3
    Insider Trading, Micro Diversity and the Long Run Macro Efficiency
    1. M Antonov
    2. G Trofimov
  4. 4
    Learning through Short-Run Macroeconomic Forecasts in a Micro-to-Macro Model
    1. M Antonov
    2. G Trofimov
    Journal of Economic Behavior an Organization 21:181–203.
  5. 5
    Complexity and the Economy
    1. B Arthur
    Science 284:107–109.
  6. 6
    The Role of Commercialization Competence in Endogenous Economic Growth
    1. G Ballot
    2. G Eliasson
    3. E Taymaz
    Paper presented at the International Joseph A. Schumpeter Society 11th ISS Conference.
  7. 7
    Agent-based modeling and economic theory: where do we stand?
    1. G Ballot
    2. A Mandel
    3. A Vignes
    Journal of Economic Interaction and Coordination 10:199–220.
  8. 8
    Human Capital, Technological Lock-in and Evolutionary Dynamics
    1. G Ballot
    2. E Taymaz
    In: G Eliasson, C Green, editors. The Micro Foundation of Economic Growth. University of Michigan Press. pp. 301–330.
  9. 9
    Technological change, learning and macro-economic coordination: An evolutionary model
    1. G Ballot
    2. E Taymaz
    Journal of Artificial Societies and Social Simulation, 2, 2.
  10. 10
    Love Thy Neighbor- A firm based multi-country model with international technology spillovers and growth regimes
    1. G Ballot
    2. E Taymaz
    Revised and extended paper presented at the DIME Workshop.
  11. 11
    Entrepreneurship in Economic Theory
    1. WJ Baumol
    The American Economic Review 58:64–71.
  12. 12
    Formal entrepreneurship theory in economics: existence and bounds
    1. WJ Baumol
    Journal of Business Venturing 8:197–210.
  13. 13
    De svenska storföretagen - en studie av internationaliseringens konsekvenser för den svenska ekonomin (The Giant Swedish Groups a Study of the Consequences of Internationalization for the Swedish Economy)
    1. F Bergholm
    De utlandsetablerade företagens drageffekter på svensk ekonomi – några simuleringar, De svenska storföretagen - en studie av internationaliseringens konsekvenser för den svenska ekonomin (The Giant Swedish Groups a Study of the Consequences of Internationalization for the Swedish Economy), IUI.
  14. 14
    A Micro Simulation of the Macro Economy with Explicitly Represented Money Flows
    1. B Bergmann
    Annals of Social and Economic Measurement, July.
  15. 15
    Micro Simulation Models, Methods and Applications. Conference Reports 1980:1
    1. B Bergmann
    2. G Eliasson
    3. G Orcutt
    4. B Bergmann
    5. G Eliasson
    6. G Orcutt
    The Transactions Model of the U.S. Economy, Micro Simulation Models, Methods and Applications. Conference Reports 1980:1, IUI.
  16. 16
    Learning, Estimation, and the Stability of Rational Expectations
    1. MN Bray
    Journal of Economic Theory 26:318–339.
  17. 17
    The Reliability of the CAPM undter Different Macro Economic Environments
    1. A Broström
    The Linköpin Institute of Technology & The Royal Institute of Technology (KTH).
  18. 18
    Are there inherent biases in applying cost-benefit analysis
    1. KJ Button
    2. JE Eklund
    Applied Ecnomics Letters pp. 1–4.
  19. 19
    Schumpeterian Perspectives on Innovation, Competition and Growth
    1. U Cantner
    2. J Gaffard
    3. L Neste
  20. 20
    Stochastic Behavior of Deterministic Systems
    1. L Carleson
    Journal of Economic Behavior and Organization 16:85–92.
  21. 21
    The content of productivity in Swedish manufacturing
    1. B Carlsson
    Research Policy 10:336–354.
  22. 22
    Industrial Subsidies in Sweden: Macro Economic Effects and an International Comparison
    1. B Carlsson
    Journal of Industrial Economics XXXII:9–14.
  23. 23
    In Microeconometrics, IUI Yearbook 1982-1983
    1. B Carlsson
    Industrial Subsidies in Sweden: Simulations on a Micro to Macro Model, In Microeconometrics, IUI Yearbook 1982-1983, IUI.
  24. 24
    Technology and Investment - Crucial Issues for the 1990s
    1. B Carlsson
    Productivity Analysis: A Micro-to-Macro Perspective, Technology and Investment - Crucial Issues for the 1990s, Pintner Publishers.
  25. 25
    Teknik och industristruktur 70 talets ekonomiska kris i historisk belysning
    1. B Carlsson
    2. E Dahmén
    3. A Grufman
    4. M Josefsson
    5. J Örtengren
    IUI and IVA.
  26. 26
    The Swedish Industrial Support Program of the 1970s revisited – A study in Micro to Macro Analytical method
    1. B Carlsson
    2. G Eliasson
    3. K Sjöö
    Paper presented at the 15th International Joseph A. Schumpeter Conference.
  27. 27
    Assessing Policies for Retirement Income. Needs for Data, Research, and Models
    1. CF Citro
    2. EA Hanushek
    Washington DC: National Research Council, National Academy Press.
  28. 28
    A Reconsideration of the Microfoundations of Monetary Theory
    1. RW Clower
    Western Economic Journal 6:1–8.
  29. 29
    Absorptive Capacity: A New Perspective on Learning and Innovation
    1. WM Cohen
    2. DA Levinthal
    Administrative Science Quarterly 35:128–152.
  30. 30
    The Problem of Externality
    1. CJ Dahlman
    Journal of Law & Economics pp. 141–162.
  31. 31
    Heterogeneous Agent Macroeconomic Model for Policy Evaluation: Improving Transpareny and Reproducibility
    1. H Dawid
    2. P Harting
    3. S Van der Hoog
    4. M Neugart
    Bielefeld University of Germany.
  32. 32
    Complex Economic Dynamics (Volume II) - An Introduction to Macroeconomic Dynamics (Draft dated 1996)
    1. R Day
    Complex Economic Dynamics (Volume II) - An Introduction to Macroeconomic Dynamics (Draft dated 1996), Draft dated 1996, Published 2000, The MIT Press.
  33. 33
    Information and Efficiency: Another Viewpoint
    1. H Demsetz
    Journal of Law and Economics 12:1–22.
  34. 34
    A Search, Equilibrium Approach to the Micro Foundiations of Macroeconomics
    1. P Diamond
    A Search, Equilibrium Approach to the Micro Foundiations of Macroeconomics, Wicksell Lectures 1982, Cambridge & London Press.
  35. 35
    Kreditmarknaden och Industrins Investeringar - En ekonometrisk studie av företagens kortsiktiga investeringsbeteende
    1. G Eliasson
    Almquist & Wicksell and IUI.
  36. 36
    The Credit Market, Investment Planning and Monetary Policy - An Econometric Study of Manufacturing Industries
    1. G Eliasson
  37. 37
    A Micro to Macro Model of the Swedish Economy, Preliminay Documentation
    1. G Eliasson
    A Micro to Macro Model of the Swedish Economy, Preliminay Documentation, Economic Research Report B15, Federation of Swedish Industries, with the assistance of Gösta Olavi and Mats Heiman.
  38. 38
    Business Economic Planning Theory, Practice and Comparison
    1. G Eliasson
    John Wiley & Sons.
  39. 39
    Competition and Market Processes in a Simulation Model of the Swedish Economy
    1. G Eliasson
    American Economic Review 67:277–281.
  40. 40
    Micro to Macro Model of the Swedish Economy. Conference Reports, 1978:1
    1. G Eliasson
    How des Inflation Affect Growth? – Experiments on the Swedish Micro to Macro Model, Micro to Macro Model of the Swedish Economy. Conference Reports, 1978:1, IUI.
  41. 41
    Micro to Macro Model of the Swedish Economy
    1. G Eliasson
    Conference Reports, 1978:1.
  42. 42
    Technical Change, Employment and Growth Experiments on a Micro to Macro Model of the Swedish Economy (Research Report No. 7)
    1. G Eliasson
  43. 43
    Electronics, Technical Change and Total Economic Performance. (Research Report No. 9)
    1. G Eliasson
  44. 44
    Datateknik, ekonomisk tillväxt och sysselsättning
    1. G Eliasson
    Elektronik, teknisk förändring och ekonomisk utveckling; (Electronics, technical change and economic development), Datateknik, ekonomisk tillväxt och sysselsättning, DEK.
  45. 45
    Microeconomic Simulation Models for Public Policy Analysis
    1. G Eliasson
    Experiments with Fiscal Policy Parameters on a Micro-to-Macro Model of the Swedish Economy, Microeconomic Simulation Models for Public Policy Analysis, 1 & 2, Academic Press.
  46. 46
    Emerging Technologies: Consequences for Economic Growth, Structural Change, and Employment
    1. G Eliasson
    Electronics, Economic Growth and Employment Revolution or Evolution?, Emerging Technologies: Consequences for Economic Growth, Structural Change, and Employment, Institut für Weltwirtschaft an der Universität Kiel.
  47. 47
    Policy Making in a Disorderly World Economy. Conference Reports 1983:1
    1. G Eliasson
    On the Optimal Rate of Structural Adjustment, Policy Making in a Disorderly World Economy. Conference Reports 1983:1, IUI.
  48. 48
    Micro Heterogeneity of Firms and Stability of Growth
    1. G Eliasson
    Journal of Economic Behavior and Organization 5:249–298.
  49. 49
    The Firm and Financial Markets in the Swedish Micro-to-Macro Model - Theory, Model and Verification
    1. G Eliasson
  50. 50
    Information Technology, Capital Structure and the Nature of Technical Change in the Firm
    1. G Eliasson
  51. 51
    The Firm as a Competent Team
    1. G Eliasson
    Journal of Economic Behavior and Organization 13:275–298.
  52. 52
    Modeling the Experimentally Organized Economy – Complex Dynamics in an Empirical Micro-Macro Model of Endogenous Economic Growth
    1. G Eliasson
    Journal of Economic Behavior and Organization 16:153–182.
  53. 53
    Coporate and Industry Strategies for Europe
    1. G Eliasson
    The International Firm: A Vehicle for Overcoming Barriers to Trade and a Global Intelligence Organization Diffusing the Notion of a Nation, Coporate and Industry Strategies for Europe, North Holland.
  54. 54
    Business Competence, Organizational Learning and Economic Growth Establishing the Smith Schumpeter Wicksell Connection
    1. G Eliasson
    In: FM Scherer, M Perlman, editors. Entrepreneurship, Technological Innovation, and Economic Growth: Studies in the Schumpeterian Tradition. University of Michigan Press. pp. 251–277.
  55. 55
    Firm Objectives, Controls and Organization - the use of information and the transfer of knowledge within the firm
    1. G Eliasson
    Academic Publishers.
  56. 56
    Technological Systems; Cases, Analyses, Comparisons
    1. G Eliasson
    General Purpose Technologies, Industrial Competence Blocs and Economic Growth, Technological Systems; Cases, Analyses, Comparisons, Academic Publishers.
  57. 57
    Global Economic Integration and Regional Attractors of Competence
    1. G Eliasson
    Industry and Innovation 10:75–102.
  58. 58
    The Birth, the Life and the Death of Firms-the role of entrepreneurship, creative destruction and conservative institutions in a growing and experimentally organized economy
    1. G Eliasson
    The Ratio Institute.
  59. 59
    The Nature of Economic Change and Management in a New Knowledge Based Information Economy
    1. G Eliasson
    Information Economics and Policy 17:428–456.
  60. 60
    IFN/IU11939 – 2009 - Sju decennier av forskning om ett näringsliv i utveckling
    1. G Eliasson
    IUI – En Privat Akademi (IUI- A Private Academy), IFN/IU11939 – 2009 - Sju decennier av forskning om ett näringsliv i utveckling, Ekerlids.
  61. 61
    Knowledge Directed Economic Selection and Growth
    1. G Eliasson
    Prometheus, 27, 4.
  62. 62
    Advanced Public Procurement as Industrial Policy – Aircraft industry as a technical university
    1. G Eliasson
  63. 63
    The incomplete Schumpeter Stockholm School connection
    1. G Eliasson
    Journal of Evolutionary Economics 25:45–56.
  64. 64
    Empirical Credibility – An Essay in Complexity Economics. Montreal
    1. G Eliasson
    Paper presented at the 16th Congress of the International Joseph A. Schumpeter Society.
  65. 65
    Foundlations of Economic Change – Behavior, Interaction and Aggregate Outcomes, Economic Complexity and Evolution
    1. G Eliasson
    Micro to Macro Evolutionary Modeling – On the economics of self organization of dynamic markets by ignorant actors, Foundlations of Economic Change – Behavior, Interaction and Aggregate Outcomes, Economic Complexity and Evolution, Berlin, Heidelberg & New York, Springer.
  66. 66
    Visible Costs, Invisible Benefits
    1. G Eliasson
  67. 67
    The Biotechnological Competence Bloc
    1. G Eliasson
    2. Å. Eliasson
    7–26, Revue d’Economie Industrielle, 78-40, Trimestre.
  68. 68
    The Theory of the Firm and the Markets for Strategic Acquisitions
    1. G Eliasson
    2. Å. Eliasson
    In: U Cantner, E Dinopoulos, RF Lanzilotti, editors. Entrepreneurship. The New Economy and Public Policy. Springer. pp. 91–115.
  69. 69
    The Modern Firm, Corporate Governance, and Investment
    1. G Eliasson
    2. Å. Eliasson
    Competence and Learning in the Experimentally Organized Economy, The Modern Firm, Corporate Governance, and Investment, Edward Elgar.
  70. 70
    Dynamik och flexibilitet i svensk IT-industry (Dynamics and Flexibility in Swedish IT-industry)
    1. G Eliasson
    2. D Johansson
    City University Press.
  71. 71
    Industrial and Corporate Change
    1. G Eliasson
    2. D Johansson
    3. E Taymaz
    Structural Change and Economic Dynamics 15:289–314.
  72. 72
    Firm Turnover and the Rate of Macroeconomic Growth
    1. G Eliasson
    2. D Johansson
    3. E Taymaz
    In: G Eliasson, editors. The Birth, the Life and the Death of Firms-the role of entrepreneurship, creative destruction and conservative institutions in a growing and experimentally organized economy. The Ratio Institute. pp. 305–356.
  73. 73
    A Micro to Macro Model of the Swedish Economy. Conference Reports, 1978:1
    1. G Eliasson
    2. G Olavi
    Stepwise parameter estimation on a micro simulation model, A Micro to Macro Model of the Swedish Economy. Conference Reports, 1978:1, IUI.
  74. 74
    Institutions, Entrepreneurship, Economic Flexibility and Growth – Experiments on an evolutionary model
    1. G Eliasson
    2. E Taymaz
    In: Cantner, Hanush, Klepper, editors. Economic Evolution, Leaning and Complexity – Econometric, Experimental and Simulation Approaches. Physica Verlag. pp. 265–286.
  75. 75
    Inflation, tax rules and investment: Some econometric evidence
    1. M Feldstein
    Econometrica 50:825–862.
  76. 76
    The Econometrics of DSGE models
    1. J Fernandez-Villaverde
    SERIEs 1:3–49.
  77. 77
    On Price Adjustment Without an Auctioneer
    1. FM Fisher
    Review of Economic Studies 39:1–15.
  78. 78
    Disequilibrium Foundiations of Equilibrium Economics
    1. FM Fisher
    Cambridge University Press.
  79. 79
    Computer simulations, mathematics and economics
    1. M Fontana
    International Review of Economics 53:96–123.
  80. 80
    The Santa Fe Perspective on Economics: Emerging patterns in the science of complexity
    1. M Fontana
    History of Economic Ideas (HEI) 2:167–196.
  81. 81
    Essays in Positive Economics
    1. M Friedman
    The Methodology of Positive Economics, Essays in Positive Economics, The University of Chicago Press.
  82. 82
    The Foundiations of Positive and Normative Economics: A Handbook
    1. X Gabaix
    2. DI Laibson
    The seven properties of good models, The Foundiations of Positive and Normative Economics: A Handbook, Oxford University Press.
  83. 83
    Macro-Modelling, Default and Money
    1. C Goodhart
    2. N Romanidis
    3. D Tsomocos
    4. M Shubik
    London School of Economics.
  84. 84
    Estimation of Ergodic Agent-Based Models by Simulating Minimum Distance
    1. J Grazzini
    2. M Richiardi
    Journal of Economic Dynamics and Control 51:148–165.
  85. 85
    The Probability Approach in Econometrics
    1. T Haavelmo
    Econometrica, 12, July, Supplement.
  86. 86
    The Empirical Foundations of Calibration
    1. LP Hansen
    2. JJ Heckman
    Journal of Economic Perspectives 10:87–104.
  87. 87
    MOSES Code
    1. KA Hanson
    Firm Entry, MOSES Code, IUI.
  88. 88
    Att Välja 80-tal. IUIs Långtidssbedömning 1979 (To choose the 80s. The IUI long–term survey 1979)
    1. IUI
  89. 89
    The Dynamics of Firm and Industry Growth – the Swedish Computing and Communications Industry
    1. D Johansson
  90. 90
    The Turnover of Firms and Industry Growth
    1. D Johansson
    Small Business Economics 24:487–495.
  91. 91
    The Theory of the Experimentally Organized Economy and Competence Blocs: an introduction
    1. D Johansson
    The Journal of Evolutionary Economics 20:185–201.
  92. 92
    Measuring the Social Returns to R&D
    1. C Jones
    2. JC Williams
    The Quarterly Journal of Economics 113:1119–1135.
  93. 93
    The Stockholm School of Economics Revisited
    1. L Jonung
    University Press.
  94. 94
    A Model of Economic Growth
    1. N Kaldor
    Economic Journal pp. 65–94.
  95. 95
    Entreprenurial Discovery and the Competitive market Process: An Austrian Approach
    1. IM Kirzner
    Journal of Economic Literature 35:60–85.
  96. 96
    A Micro to Macro Model of the Swedish Economy. IUI Conference Reports, 1978:1
    1. A Klevmarken
    On estimation and other problems of statistical inference in the micro simulation approach, A Micro to Macro Model of the Swedish Economy. IUI Conference Reports, 1978:1, IUI.
  97. 97
    Microeconometrics, IUI Yearbook 1982 1983
    1. A Klevmarken
    There is a Need for Applied Microeconometrics Survey Research about the Household, Microeconometrics, IUI Yearbook 1982 1983, IUI.
  98. 98
    Den Privata Konsumtionen 1931–1975
    1. A Klevmarken
    2. CJ Dahlman
    Almqvist & Wiksell and IUI.
  99. 99
    Risk, Uncertainty and Profit
    1. F Knight
    Houghton Mifflin.
  100. 100
    Time to Build and Aggregate Fluctuations
    1. F Kydland
    2. EE Prescott
    Econometrica 50:1345–1370.
  101. 101
    The Distribution of Work and Income
    1. WW Leontief
    Scientific American 247:188–205.
  102. 102
    Knight on Risk and Uncertainty
    1. SF LeRoy
    2. LD Singell
    Journal of Political Economy 95:394–406.
  103. 103
    Penningpolitikens Medel
    1. E Lindahl
  104. 104
    Studies in the Theory of Money and Capital
    1. E Lindahl
    George Allen & Unwin.
  105. 105
    The Markets for Innovation, Ownership and Control
    1. T Lindh
    Lessons from Learning about Rational Expectations, The Markets for Innovation, Ownership and Control, IUI and North-Holland.
  106. 106
    Evolutionary Micro-dynamics and Changes in the Economic Structure (Papers on Economics & Evolution No. 717
    1. A Lorentz
    2. M Savona
    Evolutionary Micro-dynamics and Changes in the Economic Structure (Papers on Economics & Evolution No. 717.
  107. 107
    Econometric policy evaluation: A critique
    1. RE Lucas
    Carnegie-Rochester Confer. Series on Pubic Policy.
  108. 108
    “History-friendly” Models of Industry Evolution: The Computer Industry
    1. F Malerba
    2. R Nelson
    3. L Orsenigo
    4. S Winter
    Industrial and Coporate Change 1:3–40.
  109. 109
    The Role of Anticipations and Plans in Economic Behavior and Their Use in Economic Analysis and Forecasting
    1. F Modigliani
    2. KJ Cohen
    Studies in Business Expectations and Planning, 4, (Urbana), Ill.
  110. 110
    Prisbildningsproblemet och föränderligheten
    1. G Myrdal
    Uppsala och.
  111. 111
    Some Notes on the Stockholm Theory of Saving and Investment I-II
    1. B Ohlin
    Economic Journal.
  112. 112
    Micro Simulation Models, Methods and Applications. Conference Reports 1980:1
    1. G Orcutt
    Hypothesis Formation, Testing and Estimation for Microanalytical Modeling, Micro Simulation Models, Methods and Applications. Conference Reports 1980:1, IUI.
  113. 113
    A New Type of Socio-Economic System
    1. GH Orcutt
    Review of Economics and Statistics. Reprinted with Permission in the International Journal of Microsimulation 1:3–9.
  114. 114
    Simulation of Economic Systems
    1. GH Orcutt
    The American Economic Review 50:894–907.
  115. 115
    Stockholmsskolans” begrepp och metoder. Metodologiska reflexioner kring Myrdals “Monetary Equilibrium.”
    1. T Palander
    88–143, Ekonomisk Tidskrift, XLIII, 1, Mars.
  116. 116
    Artificial Economics and Self Organisation. Agent-Based Approaches to Economics and Social Systems
    1. M Richiardi
    The missing link: AB models and dynamic microsimulation, Artificial Economics and Self Organisation. Agent-Based Approaches to Economics and Social Systems, Lecture Notes in Economics and Mathematical Systems, Vol. 669, Springer.
  117. 117
    The Future of Agent-Based Modeling
    1. MG Richiardi
    Eastern Economic Journal 43:271–287.
  118. 118
    What classical and neoclassical monetary theory really was
    1. PA Samuelson
    Journal of Economics 1:1–15.
  119. 119
    We’d Better Watch Out
    1. RM Solow
    New York Times Book Review 12:36.
  120. 120
    MOSES on PC, Manual, Initialization and Calibration
    1. E Taymaz
  121. 121
    MOSES on PC: manual, initialization, and calibration
    1. E Taymaz
    Calibration, MOSES on PC: manual, initialization, and calibration, IUI Research, IUI.
  122. 122
    MOSES Database
    1. E Taymaz
    A Description of the Initial 1982 and the Synthetic 1990 Databases, MOSES Database, IUI.
  123. 123
    A Calibration Algorithm for Micro-simulation Models
    1. E Taymaz
    Paper prepared for the special intensive course in “Microanalytic Simulation” at ERMES.
  124. 124
    Modeling the Stock and Derivatives Market in MOSES
    1. E Taymaz
    Modeling the Stock and Derivatives Market in MOSES, KTH, TRITA - IEO-R 199909, Stockholm.
  125. 125
    Free Exchange, Remaking Macro building a better model – A brief introduction to agent-based modelling
    1. The Economist
    The Economist, Jan, 31st.
  126. 126
    Free Exchange, Trend Growth – New techniques should broaden, not narrow, the discipline of economics
    1. The Economist
    The Economist, Nov, 26th.
  127. 127
    Counterfactual underwriting, Might-have-beens
    1. The Economist
    The Economist, Oct, 21st.
  128. 128
    1. O Virin
    Industrins Utveckling 1974–76 enligt (Industriförbundets Planenkät 1975/76, Specialstudie D), Industrikonjunkturen, Spring.
  129. 129
    Preiserwartungen, Monetäre Störungen und Fehlinvestitionen
    1. F Von Hayek
    Nationalökonomisk Tidskrift, 73.
  130. 130
    Microfoundations - The compatibility of microeconomics and maroeconomics
    1. RE Weintraub
    Cambridge University Press.
  131. 131
    On the Existence of a Competitive Equilibrium: 1930–1954
    1. RE Weintraub
    Journal of Economic Literature, XXI, 1.
  132. 132
    Geldzins und Güterpreise (Interest and Prices)
    1. K Wicksell
  133. 133
    Yale Economic Essays
    1. SG Winter
    225–272, Yale Economic Essays, 7, 1.

Article and author information

Author details

  1. Gunnar Eliasson

    Royal Institute of Technology (KTH), Sweden
    For correspondence


In writing this paper I have been much helped by telephone, email and personal conversations with Gerard Ballot, Johan Eklund, Anders Klevmarken, Matteo Richiardi, Erol Taymaz and Clas Wihlborg, not to mention the intensive discussion, not only of my presentation, at the 6th World congress of the International Microsimulation Association (IMA), June 21–23, 2017 in Turin, Italy.

Publication history

  1. Version of Record published: April 30, 2018 (version 1)


© 2018, Eliasson

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Download citations (links to download the citations from this article in formats compatible with various reference manager tools)

Open citations (links to open the citations from this article in various online reference manager services)