b84c2db6ff
DC-API Condor backend
...
Improvements:
- Works again with 3G Bridge.
- Compiles and deployes shared and static
libraries (tested with Condor 7.9.1-49001
nightly build).
- Improved serialize/ deserialize conforming
to 3G Bridge.
- Improved and fixed Condor userlog parsing
(using ReadUserLog).
TODO:
- still uses fixed binary names (the
algorithm name).
- does not clean up DC-API working directory.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2569 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:02 +01:00
d6c45c9496
Get rid of some warnings, update the docs (now complete).
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2463 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:10:00 +01:00
2cb497ec58
Remove DC_addWURemoteInput and DC_addWUInputAdvanced, merge into va_arg'ized
...
DC_addWUInput.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2406 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
1397ae1a2b
Added support for "remote" files at least in BOINC.
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2385 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
d47ae1c89e
- make the number of Condor submit retries and the sleep interval configurable
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2353 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
62acb628bf
_proper_ fix (r2350, r2351)
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2352 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
5ede5178a5
Try with increasing sleep time
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2351 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
38d7fffeca
Fix: If too many jobs are submitted to Condor at once, it will start refusing jobs, wait and retry.
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2350 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
d284b92e1f
- Fix typo: DC_LogicalFile does not exist.
...
- Condor backend: add support for comma separated list of
input (%I) and output (%O) files in submit template.
When there is no shared filesystem among the cluster nodes,
Condor needs a list of files ('transfer_input_files' parameter)
to copy them to the nodes.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2344 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:59 +01:00
39e5415019
Adding new public function DC_addWUInputAdvanced to support the definition of physical file name and its hash.
...
Implemented only for boinc. Other backends drop error.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2321 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:58 +01:00
85e1529d55
Rename libraries from libdc-* to libdcapi-*
...
Lintian complained about the shared library packages having a different
name than the enclosed libraries. Since nobody has been using the shared
libraries yet, and all software depending on DC-API should get the name
of the libraries from pkg-config, this change is the less distruptive.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2241 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:57 +01:00
de84a39d4a
Enable shared libraries for BOINC and local master
...
Condor does not have a shared library, and shared libraries on the
client side would be problematic ATM. Also add a debug package.
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2236 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:56 +01:00
e59812b800
Fix building with recent Condor.
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@2206 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:55 +01:00
543fc55e60
_DC_copyFile() no longer preserves errno, adjust all callers
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1941 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:55 +01:00
7613aacef5
remove temp file
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1090 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:53 +01:00
874704281c
fixes of DC_getResultCPUTime()
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1047 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:52 +01:00
ae86257672
implementation of DC_getResultCPUTime()
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1046 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:52 +01:00
202d624aa5
typo
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1035 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:51 +01:00
773382015c
use _DC_parseCfg() and _DC_copyFile() from common
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1034 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:51 +01:00
6590bdc9bc
do not use dc_internal.h in slave side
...
move _DC_state_name() to master side
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1032 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:51 +01:00
90c99142c7
state_name must be part of master only, slave compilation should fail...
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1031 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:51 +01:00
5786ad90fa
show wu state while waiting for finish
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1025 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:50 +01:00
9bc30f0b39
fix bad behavior of event processing ( #1109 )
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1008 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
aee31b8759
cache value of config param
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1007 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
16a08a8ba1
make a log message more informative
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1006 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
a6ad21ad2c
cache values of config params
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1005 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
08cf3222a8
cache values of config params
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1004 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
2f72882a82
stress test to my own test app
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1003 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
1197636ed0
remove management box when destroying wu
...
de/serialize uuid_str of the wu
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1001 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:49 +01:00
1f812e4950
fix of removing sub-direcory
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@1000 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
2b97eb0f17
check result of deserialization
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@999 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
11392c6613
use default behavior: delete files from wu's workdir when destroying it
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@998 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
06ec02d827
do not fall back to global section of the config file when figuring
...
out client log file name but use value of the DC_LABEL_CLIENTLOG instead
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@997 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
a458904f58
Fix #1106 : DC_getResultCapabilities() checks for existance of err/out files
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@996 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
8ad00421e4
file utilities
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@995 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
31f0fee320
fix #1105 : change to running state immediatelly, don't wait for condor
...
to start execution
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@994 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:48 +01:00
5f93d50a14
sajat teszt alk. forditasanak kiktatasa (fixalja a #1093-at)
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@984 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:47 +01:00
166f6e048f
test CondorSubmitTemplate parameter
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@982 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:47 +01:00
0cc3d5b554
use template file to generate condor submit file
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@981 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:47 +01:00
692cf5ab2f
new configuration parameter CondorSubmitTemplate
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@980 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:47 +01:00
4dd9bf0636
usefull functions to read file content into memory
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@979 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:47 +01:00
6b6c4cc64f
cancelation of suspended wu ( fix #1038 )
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@978 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:47 +01:00
1147ac8ad1
misztikus closedir() hiba misztikus javitasa...
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@961 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:46 +01:00
3c19b50db9
javitas a #1039-es hibahoz
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@960 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:46 +01:00
bf346829fc
kliensbol a glib.h teljes kiiktatasa
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@959 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:46 +01:00
9f79524305
de/serialize test
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@900 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:45 +01:00
bc35b2e432
de/serialize ready
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@899 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:45 +01:00
0dada2a774
fix of string unquote
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@898 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:45 +01:00
e5dc1cfe81
more data to serialized wu
...
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@897 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:45 +01:00
0795837fd0
move emacs "local-variables-block" to end of the files and place (c)
...
at the begining
git-svn-id: svn+ssh://cvs.lpds.sztaki.hu/var/lib/svn/szdg/dcapi/trunk@896 a7169a2c-3604-0410-bc95-c702d8d87f7a
2013-12-02 11:09:45 +01:00
atisu