In recent years, co-simulation has become an increasingly industrial tool to simulate Cyber Physical Systems including multi-physics and control, like smart electric grids, since it allows to involve different modeling tools within the same temporal simulation. The challenge now is to integrate in a single calculation scheme very numerous and intensely inter-connected models, and to do it without any loss in model accuracy. This will avoid neglecting fine phenomena or moving away from the basic principle of equation-based modeling.
Offering both a large number of computing cores and a large amount of distributed memory, multi-core PC clusters can address this key issue in order to achieve huge multi-simulations in acceptable time. This paper introduces all our efforts to parallelize and distribute our co-simulation environment based on the FMI for Co-Simulation standard (FMI-CS). At the end of 2016 we succeeded to scale beyond 1000 FMUs and 1000 computing cores on different PC-clusters, including the most recent HPC Infiniband-cluster available at EDF.
Keywords: Multi-Simulation, FMI, Scaling, Multi-core, PC Cluster
Proceedings of the 12th International Modelica Conference, Prague, Czech Republic, May 15-17, 2017
R. Baetens, R. De Coninck, F. Jorissen, D. Picard, L. Helsen, and D. Saelens. OPENIDEAS - An Open Framework for Integrated District Energy Simulations. In Proceedings of Building Simulation Conference 2015 (BS 2015), Hyderabad, India, December 2015.
T. Blochwitz, M. Otter, M. Arnold, C. Bausch, C. Clauß, H. Elmqvist, A. Junghanns, J. Mauss, M. Monteiro, T. Neidhold, D. Neumerkel, H. Olsson, J.-V. Peetz, and S.Wolf. The Functional Mockup Interface for Tool independent Exchange of Simulation Models. In Proceedings of the 8th International Modelica Conference, Dresden, Germany, March 2011.
B. Camus, V. Galtier, and M. Caujolle. Hybrid Co-Simulation of FMUs using DEV and DESS in MECSYCO. In Proceedings of the 2016 Spring Simulation Multiconference, Symposium on Theory of Modeling and Simulation (TMS/DEVS’16), Pasadena, CA, USA, April 2016.
K. M. Chandy and J. Misra. Distributed Simulation: A Case Study in Design and Verification of Distributed Programs. IEEE Trans. Softw. Eng., 5(5), September 1979.
C. Dad, S. Vialle, M. Caujolle, J.-Ph. Tavella, and M. Ianotto. Scaling of Distributed Multi-Simulations on Multi-Core Clusters. In Proceedings of 25th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE 2016), Paris, France, June 2016.
V. Galtier, S. Vialle, C. Dad, J.-Ph. Tavella, J.-Ph. Lam-Yee-Mui, and G. Plessis. FMI-Based Distributed Multi-Simulation with DACCOSIM. In Proceedings of the 2015 Spring Simulation Multiconference, Symposium on Theory of Modeling and Simulation (TMS/DEVS’15), USA, April 2015.
A. Kaci, H. N. Nguyen, A. Nakib, and P. Siarry. Hybrid Heuristics for Mapping Task Problem on Large Scale Heterogeneous Platforms. In Proceedings of the 6th IEEE Workshop on Parallel Computing and Optimization (PCO 2016), IPDPS Workshop 2016, Chicago, IL, USA, May 2016.
A. Ricci, M. Viroli, and A. Omicini. Give Agents Their Artifacts: The A&A Approach for Engineering Working Environments in MAS. In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS’07), Honolulu, HI, USA, May 2007. ACM.
P. Sadayappan and F. Ercal. Cluster-partitioning Approaches to Mapping Parallel Programs Onto a Hypercube. In Proceedings of the 1st International Conference on Supercomputing (ICS 1988), Athens, Greece, June 1988. Springer-Verlag.
S. E. Saidi, N. Pernet, Y. Sorel, and A. Ben Khaled. Acceleration of FMU Co-Simulation On Multi-core Architectures. In Proceedings of 1st Japanese Modelica Conference, Tokyo, Japan, May 2016.
A. Secco, I. Uddin, G. P. Pezzi, and M. Torquati. Message Passing on InfiniBand RDMA for Parallel Run-Time Supports. In Proceedings of the 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP 2014), Turin, Italy, February 2014.
J.-Ph. Tavella, M. Caujolle, S. Vialle, C. Dad, Ch. Tan, G. Plessis, M. Schumann, A. Cuccuru, and S. Revol. Toward an Accurate and Fast Hybrid Multi-Simulation with the FMI-CS Standard. In Proceedings of the IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA 2016), Berlin, Germany, September 2016.
B. P. Zeigler, T. G. Kim, and H. Praehofer. Theory of Modeling and Simulation : Integrating Discrete Event and Continuous Complex Dynamic Systems. Academic Press, 2000.