Headed to Supercomputing 2019? Register tojoin the Cylc user group以Altair天气解决方案为特色！包括午餐。

天气模型是一项挑战。它需要高性能计算（HPCbob官网 bob体育下载）资源和功能强大的软件，可以协调最复杂的循环工作负载。

Predicting Australia’s Climate and Weather

The Bureau of Meteorology is Australia’s national climate, water, and weather agency, one of the most fundamental and widely used services of the Australian government. The Bureau provides the entire continent with expertise about its “often-harsh natural environment, things like drought, floods, storms, and tropical cyclones,” says Alan Riley, project manager at the Bureau. “All these things need expertise provided to the Australian public, and that’s done through regular forecasts, warnings, monitoring, and advice that spans not only Australia, but the Antarctic Territory as well.”

The Bureau runs its numerical weather prediction (NWP) suite on its petascale Cray supercomputer. It’s using an aging SMS workflow scheduler. The Bureau needs a modern, scalable service to support the growing NWP modelling and post-processing output.

协调骑自行车的工作流程

Cylc（发音为“丝绸”）是一个用于处理一系列工作流复杂性的循环系统的开源Python工作流引擎。[看骑自行车系统的工作流程自动化，科学和工程计算，第21卷，第4期，7月/ 8月2019]. It automatically executes tasks according to detailed schedules and dependencies, and it’s especially useful in areas such as weather and climate modeling, NWP, physics simulation, and data processing. Cylc has become a popular choice at major weather and climate centers around the world — and now it’s a key tool at the Bureau of Meteorology.

With Cylc, tasks can be run as soon as dependencies are met, with maximum concurrency for more efficient use of HPC resources. Cylc was originally developed for operational environmental forecasting atNIWA, the National Institute of Water and Atmospheric Research in New Zealand, and now it’s an open-source collaboration between NIWA, the遇见办公室(UK), the Center of Excellence for Weather and Climate Simulation in Europe (ESiWACE), the Bureau of Meteorology, and other contributors.

“骑自行车与实时调度不一样，”Niwa的Hilary Oliver，Sourcoply of Cylc。“如果系统捕获到时钟，则当运行时钟和实时调度时，Quanc可以在调度时无缝过渡。”

Bureau of Meteorology program director Tim Pugh told us that one reason his organization chose Cylc is for its effective use in research and operations. “The selection of Cylc as the workflow scheduler for our operations was very simple,” he said. “We’re using it in research. By using it in production it meant a very simple transition of our HPC applications and numerical prediction from research into operations.”

Cylc and Altair PBS Professional™

Converting complex, critical systems to a new open-source workflow engine can be a daunting prospect — so Altair, with NIWA and the Australian Bureau of Meteorology, developed a production environment for monitoring the performance of many Cylc workflows along with the PBS Professional workload manager.

PBS Professionalis Altair’s industry-leading workload manager and job scheduler for HPC and cloud environments, part of theAltair PBS Works™suite. It allows HPC users to simplify HPC infrastructure management and optimize system utilization, improving application performance and maximizing ROI on hardware and software investments.

Altair已经为主席团提供PBS专业人员，以管理HPC系统上的资源。随着SMS调度程序被弃用并需要更换，主席团正在寻找商业供应商，为他们的气缸工作流提供支持，因为Cylc是没有商业支持的开源。

Why the Bureau of Meteorology Chose Altair

由于其对HPC系统的了解以及我们需要与产品融合的需要，“Altair被选为协助该局，”Tim Pugh说。“PBS Professional在我们的HPC系统提供工作资源管理和调度。这对系统至关重要，这样如果该服务要下跌，那么我们认为整个系统中断。Altair明白了这一点。“他说，合作伙伴关系，“让我们每天都在局预测中心所需的每一天实现结果。”

David Block, project manager at Altair, added, “Altair has a long history of listening to our customers and producing robust solutions on time and on target. Altair is collaborating with the Bureau to build a general-purpose solution to assist weather and climate staff with monitoring their environment, and then providing the diagnostics necessary to pinpoint any issue.”

Currently, staff members at many sites are required to constantly monitor the environment. The new solution will alert them via a push mechanism. It will also allow them to monitor the supercomputer hardware, Cylc suites, and PBS Professional jobs, and report status clearly and concisely. The solution is being designed to be modular and general-purpose so any site can deploy it out of the box, or substitute components they’re more familiar with. Altair is building several components as well as making contributions to Cylc.

“Due to the use of open-source software,” said Block, “sites around the world can implement the solution and work with the communities to make improvements. Altair is also available to support any site that installs the solution.”

Continuing to Improve Cylc

在南国Cylc + PBS专业集成ia’s Bureau of Meteorology will unify a large production system with many workflows using PBS Professional and the open-source Kafka message broker. “Altair brings significant commercial expertise to the open-source project,” said NIWA’s Dr. Oliver, “and they’re supporting Cylc development to modernize the graphic user interface and improve security.”

The Bureau’s Alan Riley added, “Simply moving to Cylc solves a lot of problems we’ve spoken about, but the project is also moving on. It’s doing some extra things to improve the system even more.” Areas in which the collaboration continues to evolve include:

• 安全功能
• Cross-scheduler triggering via Apache Kafka
• Communication between SMS and Cylc suites and vice versa
• Enhanced reporting
• BI tool support for dashboarding and performance analysis
• Integration with the Bureau’s enterprise monitoring tool

包括一个额外的即将Cylc改进ll-new web-based control panel with tools that give support teams more control and better monitoring capabilities. Cylc version 8 will be a major rearchitecting of Cylc for modern web technologies. Altair will continue to be active in the Cylc community.

学习更多关于CylcandPBS Professional.