NexComm 2022 Congress
April 24, 2022 to April 28, 2022 - Barcelona, Spain

  • ICDT 2022, The Seventeenth International Conference on Digital Telecommunications
  • SPACOMM 2022, The Fourteenth International Conference on Advances in Satellite and Space Communications
  • ICN 2022, The Twenty-First International Conference on Networks
  • ICONS 2022, The Seventeenth International Conference on Systems
  • MMEDIA 2022, The Fourteenth International Conference on Advances in Multimedia
  • PESARO 2022, The Twelfth International Conference on Performance, Safety and Robustness in Complex Systems and Applications
  • CTRQ 2022, The Fifteenth International Conference on Communication Theory, Reliability, and Quality of Service
  • ALLDATA 2022, The Eighth International Conference on Big Data, Small Data, Linked Data and Open Data
  • SOFTENG 2022, The Eighth International Conference on Advances and Trends in Software Engineering

ComputationWorld 2022 Congress
April 24, 2022 to April 28, 2022 - Barcelona, Spain

  • SERVICE COMPUTATION 2022, The Fourteenth International Conference on Advanced Service Computing
  • CLOUD COMPUTING 2022, The Thirteenth International Conference on Cloud Computing, GRIDs, and Virtualization
  • FUTURE COMPUTING 2022, The Fourteenth International Conference on Future Computational Technologies and Applications
  • COGNITIVE 2022, The Fourteenth International Conference on Advanced Cognitive Technologies and Applications
  • ADAPTIVE 2022, The Fourteenth International Conference on Adaptive and Self-Adaptive Systems and Applications
  • CONTENT 2022, The Fourteenth International Conference on Creative Content Technologies
  • PATTERNS 2022, The Fourteenth International Conference on Pervasive Patterns and Applications
  • COMPUTATION TOOLS 2022, The Thirteenth International Conference on Computational Logics, Algebras, Programming, Tools, and Benchmarking
  • BUSTECH 2022, The Twelfth International Conference on Business Intelligence and Technology

InfoSys 2022 Congress
May 22, 2022 to May 26, 2022 - Venice, Italy

  • ICNS 2022, The Eighteenth International Conference on Networking and Services
  • ICAS 2022, The Eighteenth International Conference on Autonomic and Autonomous Systems
  • ENERGY 2022, The Twelfth International Conference on Smart Grids, Green Communications and IT Energy-aware Technologies
  • WEB 2022, The Tenth International Conference on Building and Exploring Web Based Environments
  • DBKDA 2022, The Fourteenth International Conference on Advances in Databases, Knowledge, and Data Applications
  • SIGNAL 2022, The Seventh International Conference on Advances in Signal, Image and Video Processing
  • BIOTECHNO 2022, The Fourteenth International Conference on Bioinformatics, Biocomputational Systems and Biotechnologies

InfoWare 2022 Congress
May 22, 2022 to May 26, 2022 - Venice, Italy

  • ICCGI 2022, The Seventeenth International Multi-Conference on Computing in the Global Information Technology
  • ICWMC 2022, The Eighteenth International Conference on Wireless and Mobile Communications
  • VEHICULAR 2022, The Eleventh International Conference on Advances in Vehicular Systems, Technologies and Applications
  • INTERNET 2022, The Fourteenth International Conference on Evolving Internet
  • COLLA 2022, The Twelfth International Conference on Advanced Collaborative Networks, Systems and Applications
  • INTELLI 2022, The Eleventh International Conference on Intelligent Systems and Applications
  • VISUAL 2022, The Seventh International Conference on Applications and Systems of Visual Paradigms
  • HUSO 2022, The Eighth International Conference on Human and Social Analytics
  • BRAININFO 2022, The Seventh International Conference on Neuroscience and Cognitive Brain Information

DataSys 2022 Congress
June 26, 2022 to June 30, 2022 - Porto, Portugal

  • AICT 2022, The Eighteenth Advanced International Conference on Telecommunications
  • ICIW 2022, The Seventeenth International Conference on Internet and Web Applications and Services
  • ICIMP 2022, The Seventeenth International Conference on Internet Monitoring and Protection
  • SMART 2022, The Eleventh International Conference on Smart Cities, Systems, Devices and Technologies
  • IMMM 2022, The Twelfth International Conference on Advances in Information Mining and Management
  • INFOCOMP 2022, The Twelfth International Conference on Advanced Communications and Computation
  • MOBILITY 2022, The Twelfth International Conference on Mobile Services, Resources, and Users
  • SPWID 2022, The Eighth International Conference on Smart Portable, Wearable, Implantable and Disability-oriented Devices and Systems
  • ACCSE 2022, The Seventh International Conference on Advances in Computation, Communications and Services

DigitalWorld 2022 Congress
June 26, 2022 to June 30, 2022 - Porto, Portugal

  • ICDS 2022, The Sixteenth International Conference on Digital Society
  • ACHI 2022, The Fifteenth International Conference on Advances in Computer-Human Interactions
  • GEOProcessing 2022, The Fourteenth International Conference on Advanced Geographic Information Systems, Applications, and Services
  • eTELEMED 2022, The Fourteenth International Conference on eHealth, Telemedicine, and Social Medicine
  • eLmL 2022, The Fourteenth International Conference on Mobile, Hybrid, and On-line Learning
  • eKNOW 2022, The Fourteenth International Conference on Information, Process, and Knowledge Management
  • ALLSENSORS 2022, The Seventh International Conference on Advances in Sensors, Actuators, Metering and Sensing
  • SMART ACCESSIBILITY 2022, The Seventh International Conference on Universal Accessibility in the Internet of Things and Smart Environments

NetWare 2022 Congress
October 16, 2022 to October 20, 2022 - Lisbon, Portugal

  • SENSORCOMM 2022, The Sixteenth International Conference on Sensor Technologies and Applications
  • SENSORDEVICES 2022, The Thirteenth International Conference on Sensor Device Technologies and Applications
  • SECURWARE 2022, The Sixteenth International Conference on Emerging Security Information, Systems and Technologies
  • AFIN 2022, The Fourteenth International Conference on Advances in Future Internet
  • CENICS 2022, The Fifteenth International Conference on Advances in Circuits, Electronics and Micro-electronics
  • ICQNM 2022, The Sixteenth International Conference on Quantum, Nano/Bio, and Micro Technologies
  • FASSI 2022, The Eighth International Conference on Fundamentals and Advances in Software Systems Integration
  • GREEN 2022, The Seventh International Conference on Green Communications, Computing and Technologies

SoftNet 2022 Congress
October 16, 2022 to October 20, 2022 - Lisbon, Portugal

  • ICSEA 2022, The Seventeenth International Conference on Software Engineering Advances
  • ICSNC 2022, The Seventeenth International Conference on Systems and Networks Communications
  • CENTRIC 2022, The Fifteenth International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services
  • VALID 2022, The Fourteenth International Conference on Advances in System Testing and Validation Lifecycle
  • SIMUL 2022, The Fourteenth International Conference on Advances in System Simulation
  • SOTICS 2022, The Twelfth International Conference on Social Media Technologies, Communication, and Informatics
  • INNOV 2022, The Eleventh International Conference on Communications, Computation, Networks and Technologies
  • HEALTHINFO 2022, The Seventh International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing

NexTech 2022 Congress
November 13, 2022 to November 17, 2022 - Valencia, Spain

  • UBICOMM 2022, The Sixteenth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
  • ADVCOMP 2022, The Sixteenth International Conference on Advanced Engineering Computing and Applications in Sciences
  • SEMAPRO 2022, The Sixteenth International Conference on Advances in Semantic Processing
  • AMBIENT 2022, The Twelfth International Conference on Ambient Computing, Applications, Services and Technologies
  • EMERGING 2022, The Fourteenth International Conference on Emerging Networks and Systems Intelligence
  • DATA ANALYTICS 2022, The Eleventh International Conference on Data Analytics
  • GLOBAL HEALTH 2022, The Eleventh International Conference on Global Health Challenges
  • CYBER 2022, The Seventh International Conference on Cyber-Technologies and Cyber-Systems

TrendNews 2022 Congress
November 13, 2022 to November 17, 2022 - Valencia, Spain

  • CORETA 2022, Advances on Core Technologies and Applications
  • DIGITAL 2022, Advances on Societal Digital Transformation

 


ThinkMind // CLOUD COMPUTING 2021, The Twelfth International Conference on Cloud Computing, GRIDs, and Virtualization // View article cloud_computing_2021_3_30_20014


Take Me to the Clouds Above: Bridging On Site HPC with Clouds for Capacity Workloads

Authors:
Jay Lofstead
Dmitry Duplyakin

Keywords: Cloud; HPC; Cloud Bursting; schedulers;

Abstract:
Sites with limited compute cluster capacity aimed at supporting large-scale applications of scientific and parallel computing must deal with the additional demand for small-scale jobs---in many cases, single-node and coming in large volumes---that help further develop the capabilities of large-scale applications as well as run simple data analysis tasks. Many of these analysis tasks and other small-scale jobs are run on High Performance Computing (HPC) systems because they offer familiar environments, making future scaling convenient, or because the proximity to the input or output data sets is important. When these small-scale jobs explode in count and create significant competition for resources, ensuring that the most effective use of the cluster resources is achieved requires either non-trivial scheduler tuning for better management of job mixes or adoption of entirely different models for management of computing environments. We claim that a hybrid ``on-site HPC + cloud'' model can offer the best of both worlds. Thus, small jobs should target cloud resources in cases where they can be offloaded to clouds without significant penalties on performance, and, at the same time, large-scale application runs can better utilize HPC clusters, achieving lower wait times and increasing job throughput. This is not without challenges.

Pages: 54 to 59

Copyright: Copyright (c) The Government of USA, 2021. Used by permission to IARIA.

Publication date: April 18, 2021

Published in: conference

ISSN: 2308-4294

ISBN: 978-1-61208-845-7

Location: Porto, Portugal

Dates: from April 18, 2021 to April 22, 2021

SERVICES CONTACT
2010 - 2017 © ThinkMind. All rights reserved.
Read Terms of Service and Privacy Policy.