Commit Graph

23055 Commits

Author SHA1 Message Date
a.visegradi 0baca047b1 Empty files are not uploaded by BOINC; this makes higher level applications to fail. Modified DC-API-boinc to create missing files.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2573 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
atisu b84c2db6ff DC-API Condor backend
Improvements:
 - Works again with 3G Bridge.
 - Compiles and deployes shared and static 
   libraries (tested with Condor 7.9.1-49001 
   nightly build).
 - Improved serialize/ deserialize conforming 
   to 3G Bridge.
 - Improved and fixed Condor userlog parsing 
   (using ReadUserLog).
 
 TODO:
 - still uses fixed binary names (the 
   algorithm name).
 - does not clean up DC-API working directory.





git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2569 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
atisu f1caf2d38b Fix: MaxOutputSize now accepts values larger than 2GB
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2557 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
atisu 36b0b7b874 DC_FILE_IN type files should only be resolved if present. Fixes uppercase example initial checkpoint file bug
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2536 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
atisu 6c10ad3a94 - prepare for new release (...)
- add support for sticky files on clients



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2530 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
atisu 821e29d001 - fix typos in InputURLRewriteRegExp* .
- add documentation for MinQuorum, TargetNResults, 
   MaxErrorResults and MaxTotalResults.



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2529 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
atisu fb918d73e0 - revert to r2524 and new release: 0.12-1 broke handling of remote files
when invoked from previously compiled binaries/ libraries.



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2527 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
atisu 2910b42687 - introduced persistent on clients option for
input files: DC_FILE_PERSISTENT_CLIENT 
   (not documented/ unofficial)
 - added static prefix for replace_regex() (it should not be exposed)



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2525 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
atisu 540c7790fd - fine tune redundancy parameters
- for old "Redundancy" parameter create n+1 results rather than
   n results (current documentation states n+1)




git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2524 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
zfarkas cfddcfd907 Increased version number.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2510 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
zfarkas 9a21c9c439 Added docs about URL rewrite.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2509 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
zfarkas e53f4ece2f Some docs update.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2507 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
zfarkas 08d54b1280 Fix EDGI Bug #91: add handling the UploadURL configuration variable for output file uploads.
Fix workunit description parsing (also read remote files).


git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2506 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
zfarkas 814237b798 Add input file URL substitution for http and attic files (TODO: docs).
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2505 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
atisu 7ac33bb384 -update symbols
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2471 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
atisu b0ea53f9c1 update list of authors
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2470 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
atisu e33ceeed83 - megnyertem a tombolan
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2469 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:01 +01:00
zfarkas 7fd0fbddd6 0.9 -> 0.10 instead of 0.9 -> 0.91
Prepare relesse


git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2466 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas 8306bdd4af Fix DC-API build.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2465 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas d6c45c9496 Get rid of some warnings, update the docs (now complete).
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2463 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas 6a953dfaec Remove not existing function.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2462 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
smith 4da13c9b5d Incrementing version from 1.0.0 to 1.0.1. One extra function called DC_setWUBatch has been
added, therefore "This release has a new, but backwards incompatible interface" . See 
http://sourceware.org/autobook/autobook/autobook_91.html for reasons of version change.



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2460 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
smith 3c1832c9f9 Fix typo and add the function to the header.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2457 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
smith 558d300726 Adding DC_setWUBatch function.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2456 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
smith 1a5650397a Adjusting attic file handling.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2447 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas b3ddc658b9 Do not report local files as unsupported.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2428 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas 848d37f6c6 strncmp returns match as 0.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2427 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas 49d8a70931 A little update on ADICS.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2426 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
zfarkas ff5a29e03b Remove printf, fix illegal instruction, and one printf warning.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2423 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
zfarkas e7b1c31166 Fuuuu selective copy-paste :)
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2408 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
zfarkas 44e9fbf44c Use size_t instead of int for remote file size.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2407 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
zfarkas 2cb497ec58 Remove DC_addWURemoteInput and DC_addWUInputAdvanced, merge into va_arg'ized
DC_addWUInput.


git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2406 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
zfarkas 1397ae1a2b Added support for "remote" files at least in BOINC.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2385 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
atisu d47ae1c89e - make the number of Condor submit retries and the sleep interval configurable
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2353 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
atisu 62acb628bf _proper_ fix (r2350, r2351)
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2352 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
atisu 5ede5178a5 Try with increasing sleep time
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2351 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
atisu 38d7fffeca Fix: If too many jobs are submitted to Condor at once, it will start refusing jobs, wait and retry.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2350 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
atisu e45d5f41ba fix typo in documentation
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2345 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
atisu d284b92e1f - Fix typo: DC_LogicalFile does not exist.
- Condor backend: add support for comma separated list of 
   input (%I) and output (%O) files in submit template.
   When there is no shared filesystem among the cluster nodes,
   Condor needs a list of files ('transfer_input_files' parameter)
   to copy them to the nodes.



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2344 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
smith 6c12f48dd4 DC_getWUId is modified to return the boinc database id of the wu.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2323 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
smith 39e5415019 Adding new public function DC_addWUInputAdvanced to support the definition of physical file name and its hash.
Implemented only for boinc. Other backends drop error.



git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2321 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
smith bc1fff6de5 Commented text has been removed.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2317 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
smith 0d143bf7c7 Modifying md5 has file creation for DC_addWUInput():
Hash file is created directly in the boinc download directory instead of the DC-API workunit working directory.


git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2316 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
smith 0d28e98f9f DC_addWUInput function is modified to receive externally generated hash for the input file. This hash is received and stored under boinc in a file with the same name and extension ".md5".
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2315 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
gombasg 725f19acbc Build fix with gcc-4.4
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2307 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
gombasg 2213eb6f87 Handle optimization failures gracefully
DC_FILE_PERSISTENT and DC_FILE_VOLATILE are just optimizations so if
the implied operation fails, just fall back to regular copying instead
of aborting the WU submission.

git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2305 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
gombasg 61c1eab9b3 Add support for native BOINC client applications
If the client configuration in dc-api.conf has "NativeClient = yes", do
not add DC-API specific input and output files.
Also change the default of EnableSuspend to false.

git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2295 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
gombasg 6feecbc9d8 Get rid of an unused definition
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2294 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
gombasg d65b45c063 Fix the location of the Python modules
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2292 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
gombasg 78ece805ee Use m4_ifval() instead of m4_ifblank()
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2285 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00