Rooba
/
boinc
mirror of https://github.com/BOINC/boinc.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Page: WorkShop09_VmApps
Pages
API Implementation ATI Radeon Account managers AccountControl AccountManagement AccountManagers Adaptive Replication AdminAlphaTest AdminApprovedProjects AdminDepLibs AdminDepLibsCurl AdminDepLibsOpenSSL AdminDepLibsSqlite AdminDepLibsZlib AdminInstallerMac AdminInstallerUnix AdminInstallerWin AdminLocalize AdminReleaseAndroid AdminReleaseManagement AdminRoles AdminTasks AdminWrappers Advanced view AlphaInstructions AndroidBoinc AndroidBoincImpl AndroidBoincTesting AndroidBoincTodo AndroidBuildApp AndroidBuildClient AndroidBuildStatus AndroidGuiDiscuss Anonymous platform AppCoprocessor AppDebug AppDebugAndroid AppDebugWin AppDev AppFiltering AppIntro AppLibraries AppMultiThread AppPlan AppPlanSpec AppVersion AppVersionNew Apple Metal Support AssignedWork Assimilation introduction Assimilators in C Assimilators in scripting languages AutoFlops AutoUpdate BOINC Client BOINC Data directory BOINC Help BOINC Manager BOINC Security BOINC screensaver BOINC apps (introduction) BOINC community BOINC events BOINC overview BOINC projects BOINC software development BOINConPhones BUDA implementation BUDA job submission BUDA overview BUDA setup BackendLogic BackendPrograms BackendState BackendUtilities BadgeDoc BadgesOld BashCommandCompletion BasicApi BasicConcepts BerkeleyTasks BetaTest BlackList BoincBasics BoincContributersCall BoincDocker BoincFiles BoincGovernanceWorkingGroups BoincIntro BoincLite BoincPapers BoincPlatforms BoincPmcPage BoincPr BoincProjectsCall BoincSecurity Boinccmd tool BuildClientProcedure BuildMacApp Building BOINC on Unix Building BOINC software CamelCase CancelJobs CertSig Changes to this Wiki Choosing and joining projects Client configuration Client release notes ClientAppConfig ClientDataModel ClientFiles ClientFsm ClientLogic ClientOpaque ClientSched ClientSchedOctTen ClientSchedOld ClientSchedVersionFour ClientSetupLogicWin ClientSetupLogicWinFileLayout ClientSetupLogicWinSix ClientSetupLogicWinSixCleanup ClientSetupWinSix ClientSim CloudServer CodeSigning CodingStyle CommIntro Command line job submission CompileApp CompileAppLinux CompileAppWin CompileClient CompileWithWxWidgets CompoundApps Computation credit Computing with BOINC CondorBoinc ConferenceList Contact BOINC ContributePage Controlling BOINC remotely CoreClient CpuSched Create a BOINC server (cookbook) CreateProjectCookbook Creating a skin for the BOINC Manager Creating custom installers CreditAlt CreditGeneralized CreditNew CreditNotes CreditOptions CreditProposal CreditStats CrossProjectUserId CudaApps DataBase DataFlow DbDump DbIds DbPurge DebugClientWin DeleteFile Deploy Linux apps using VirtualBox (cookbook) DesignKeywords DesktopGrid DevMethodologies DevProcess DevProjects DevProjects_New DevQualityAssurance Development_Workflow DiagnosticsApi DirHierarchy DiskManagement Docker and WSL Docker app cookbook Docker app implementation Docker apps Docker design alternatives DownloadInfo DownloadOther DrupalConversion DrupalIntegration EastCoast08 Editing computing preferences with the BOINC Manager EmBoinc EmailChangeNotification EmailLists Error handling (cookbook) Error handling (introduction) ErrorReference Error_Abortingtask_Exceededdisklimit Error_Cantdeletepreviousstatefile Error_Givinguponupload Error_Schedulerrequestfailed ExampleApps FileCompression FileDeleter FileList FileUpload FortranApps Fossils GPU computing GPUApp GSoC_13 GdprCompliance GetFile GetFileList GitMigration Global prefs override.xml Going public GpuSched GpuSync GpuWorkFetch GraphicsApi GraphicsApiOld GraphicsApps GraphicsHtml GridIntegration GuiRpc GuiRpcProtocol GuiUrls HTMLGfx HarzPics Heat and energy considerations Home Homogeneous App Version Homogeneous Redundancy Host identification and merging HostId HostMeasurement How BOINC works HtmlOps Initialization files InstallDrupal Installing BOINC on Debian or Ubuntu Installing BOINC on EC2 Installing BOINC on Fedora Installing BOINC on Gentoo Installing BOINC on Ubuntu Installing BOINC Installing on Android Installing on FreeBSD Installing on Linux Installing on MacOS Installing on Windows IntermediateUpload JavaApps Job processing (cookbook) Job processing (introduction) Job replication JobEst JobIn JobIntro JobKeywords JobPinning JobPrioritization JobReplication JobSched JobSizeMatching JobStage JobStatus JobSubmission JobTemplates KeySetup LammpsRemote LdapSupport Linux file permissions Linux DEB and RPM support Linux installer LocalityNew LocalityScheduling Locating stolen computers LogExtension LogRotate LowLatency MacBacktrace MacBuild MacDeveloper MacDeveloperProjects Maintain your BOINC project MakeProject ManagerImpl ManagerMenus MasterUrl MediaWiki MemoryManagement Missing Linux shared libraries MpiApps MultiHost MultiSize MultiUser MultiUserPriority MysqlConfig Network related problems NetworkApps NonCpuIntensive Notifications OpenCL Applications OpenCL CPU applications OpenId OpenclCpu OptionsApi OrgGrid OtherProjectDocs PMC_Minutes PMC_Minutes_2017_12_15 PMC_Minutes_2018_01_10 PageTemplates PasswordHash PayPalDonations Per user file sandbox PerAppCredit PersFileXfer PhpDb PhysicalFileManagement PlanClassFunc PortalFeatures PowerManagement Preferences PreferencesXml Prefs2 PrefsImpl PrefsOverride PrefsPresets PrefsReference PrefsReference_Time PrefsRemodel PrefsUnification PrepareLinuxBuildMachine Process_proposals ProfileScreen ProjectConfigFile ProjectDaemons ProjectDefaults ProjectGovernance ProjectLaunch ProjectMain ProjectNews ProjectNotices ProjectOptions ProjectPapers ProjectPlan ProjectSecurity ProjectSelect ProjectSkin ProjectSpecificPrefs ProjectSponsors ProjectTasks ProofOfOwnership Proposal_ProjectSimpleAccountCreation ProtectionFromSpam Proxy servers ProxyServer PyMw PythonAppDev PythonApps PythonFramework PythonMw PythonMysql QuickStart RecentChanges Reduce_usage_of_authenticator Reduce_usage_of_authenticator_implementation ReleaseNotes RemoteInputFiles RemoteJob RemoteJobs RemoteLogs RemoteOutputFiles RemoteOverview Reporting client bugs ResearchProjects RightToErasure RpcAuth RpcPolicy RpcProtocol RpmSpec Running Linux apps on BOINC RuntimeEstimation SandBox SandboxUser SchedMatch Scientist interface ScreensaverEnhancements ScreensaverLogic SecureHttp SecurityIssues SendFile Server release notes Server trouble‐shooting ServerComponents ServerDirs ServerIntro ServerSecurity ServerStatus ServerTestInstructions ServerUpdates Simple view Simple attach usage SimpleAttach SingleJob SingleJobImpl SkinExamples SoftwareAddon SoftwareDevelopment SoftwarePrereqsUnix SoftwareTesting SolarisClient SolrIntegration Source code map SourceCode SourceCodeGit SourceCodeGit_Commands SourceCodeGit_Windows SourceCodeGit_WindowsKeygen SourceCodeGit_WorkFlow SourceCodeSvn Sporadic Applications Standard assimilators Standard validators StartTool Starting BOINC on boot (Unix) StatsXml StatusApi StolenComputers Stop or start BOINC daemon after boot StripChart StyleSheets SuperHost TeamDiscussion TeamImport Teams TemplateImages TermsOfUse The BOINC out of box experience The BOINC test drive ToolUpgrade Tools for MacOS TranslateIntro TranslateProject Translate_Coordination TranslationSystem TreeThreader TrickleApi TrickleImpl TrickleMessages TroubleshootClient TroubleshootClient_New Troubleshooting Tutorial_BOINCApplicationDevelopmentLifecycle Tutorial_DeployingVMApplications UnixClientPackage UnixProjectPackage UpdateVersions UploadStatistics Usage rules User manual UserJobs UserOptInConsent Using BOINC with modem, ISDN and VPN connections UsingSvn ValidationLowLevel Validators in C Validators in scripting languages Validators VboxApps Vboxwrapper release notes VersionDiff VersionHistory VersionPathSorter VirtualBox Plan VirtualBox VirtualCampusSupercomputerCenter VirtualMachines Virtualbox Shared Directories VmApps VmCompatibility VmServer Volunteer VolunteerComputing VolunteerDataArchival VolunteerRecruit VolunteerStorage WSL apps WatchDog Weak account key WebCache WebConfig WebForum WebResources WebRpc WebSubmit WebTemplateProposal WhyUseBoinc WikiTodo WinMulticore WindowsIssues WordPressInt WorkDistribution WorkFetchMaxConcurrent WorkGeneration WorkShop07 WorkShop07_BoincGrid WorkShop07_BoincSched WorkShop07_InterpretedApps WorkShop07_PubBoincOne WorkShop07_PubBoincTwo WorkShop07_SecurityGroup WorkShop07_SimplifyApp WorkShop07_Summary WorkShop07_VirtualMachines WorkShop07_WebCode WorkShop08 WorkShop08_WorkshopProceedings WorkShop09 WorkShop09_BatchSched WorkShop09_InterprocComm WorkShop09_ScientistUsability WorkShop09_UserIssues WorkShop09_VmApps WorkShop10 WorkShop10_VmApps WorkShop10_VolunteerIssues WorkShop11 WorkShop11_HackFest WorkShop11_HackFest_Android WorkShop11_MultiUser WorkShop12 WorkShop12_WorkshopSummary WorkShop13 WorkShop13_HackfestNotes WorkShop14 WorkShop18 WorkShop19 Worker release notes WorldWideLexicon Wrapper release notes WrapperApp XaddTool XmlFormat XmlNotes XmlStats test_RunningBoinc
2 WorkShop09_VmApps
Vitalii Koshura edited this page 2023-04-13 15:22:41 +02:00
Table of Contents

VM Apps

Notes taken by Ben Segal

Present

Uwe Beckert / Rechenkraft.net, Oliver Bock / MPI, Ignasi Buch / GRIB, Oscar Diaz / PUCP, Joseph Emeras / INRIA, David Garcia Quintas / CERN, Daniel Lombrana Gonzalez / Univ. Extremadura, Attila Marosi / SZTAKI, Nico Mittenzwey / Rechenkraft.net, Jarno Rantala / TUT, Michael Weber / Rechenkraft.net, and myself (12 in all). (Others copied in this email are followers of the BOINC-VM discussions which began at last year's BOINC Workshop in Grenoble).

Introduction

Ben introduced the discussion by referring to work done on this topic over the last 3 years, most of which is documented on the BOINC Wiki at: VmApps

The intention is to build a solid infrastructure in BOINC to support applications running in guest VM's hosted by a BOINC client, as compatibly as possible with applications running in the client itself. Our intention is to coordinate work as far as possible in this developing area to avoid needless duplication of effort.

In particular, two new pieces of work have been done at CERN this year and were reported at this BOINC Workshop (the presentations by David Garcia Quintas and Jarno Rantala). Their slides will be available at: WorkShop09.

For additional information on these two projects see:

  • VM Controller software (by David Garcia Quintas) at: VirtualBox This is a general-purpose communication layer permitting host processes to control a hypervisor and exchange messages and files with it and all its guest VM's via an XML-RPC interface. It supports an open-ended set of hypervisors, with VirtualBox the first to be fully implemented.

  • VM Wrapper program (by Jarno Rantala) at: VmApps This is a rewritten BOINC Wrapper, back-compatible with the original Wrapper, but which launches and controls applications inside VM's if supplied with a suitably modified job.xml file. No changes are needed to the BOINC core client or server software.

Work To Do

The above software has already run an impressive demonstration at CERN, with a Linux BOINC client running jobs for a real physics experiment. It requires some more work to turn it into a rugged system supporting all major BOINC client platforms out on the Internet.

Specific "To Do" lists of work remaining will be posted on the BOINC Wiki shortly.

Proposed collaborations

Several members of the BOINC community have offered their collaboration to test and extend the above approach:

  • Daniel Lombrana (U. Extremadura): To test with Windows clients and extend it to support the VMWare hypervisor.
  • INRIA (Derrick Kondo and Joseph Emeras): To test with MacOSX clients and extend support to kQEMU.
  • Attila Marosi (SZTAKI): To explore its use and development for a PhD thesis project.
  • Jeremy Cowles (UC Berkeley): To help with automatic BOINC deployment of the Python components needed.
  • CERN (Ben Segal and others): To use the system in conjunction with the CernVM image manager to run problems in High Energy Physics. (This system makes BOINC appear as a "Volunteer Cloud" and is described in a recent paper at: http://www.cern.ch/ben/Ven_abs.pdf ) ( Information on the CernVM project can be found at: http://cernvm.web.cern.ch/cernvm/ )

Related areas of interest

During the BOF discussion, several areas of activity of interest for VM applications within BOINC were mentioned:

  1. Image generation and management
  • Attila Marosi (SZTAKI) and Oliver Bock (MPI) have experience with VM image size reduction and management using overlays.
  • A colleague of Attila at SZTAKI (Gabor Kecskemeti) was active in a project to generate VM images, independent of CernVM.
  • Joseph Emeras (INRIA) expressed interest in image generation using CernVM.
  1. GPU's and VM's
  • Oliver Bock (MPI) proposed a "standard VM image" to ease porting problems with GPU drivers on miscellaneous platforms.
  1. Checkpointing
  • Michael Weber and Nico Mittenzwey (Rechenkraft.net) proposed using VM's as a way to provide checkpointing for certain BOINC applications which could not be checkpointed by conventional means.

BOINC support for VM applications

Although our approach minimizes required changes to the BOINC infrastructure, there was a short discussion during the BOF report to the full meeting, concerning the need for hypervisor installation on BOINC client nodes before they could be used for VM applications. David Anderson said that "at the top of his list" of developments was a fix whereby an alert would be given to a volunteer attaching to a BOINC-VM project, requesting the installation of the required hypervisor before continuing.

Thanks to all the BOF attendees as well as to all those interested in working in development of VM support for BOINC.

Home