mirror of https://github.com/BOINC/boinc.git
225 lines
8.0 KiB
HTML
225 lines
8.0 KiB
HTML
<? // -*- html -*-
|
|
// $Id$
|
|
require_once("docutil.php");
|
|
page_head("Python Framework");
|
|
?>
|
|
|
|
See the section on Python in the <a href=software.php>Software
|
|
Prerequisites</a>.
|
|
|
|
<h1>Structure</h1>
|
|
|
|
The directory <code>boinc/py/Boinc</code> contains the <code>Boinc</code>
|
|
module. This means if you have <code>boinc/py/</code> in your python path you can
|
|
write for example:
|
|
<blockquote>
|
|
<code>from Boinc.setup_project import *</code>
|
|
</blockquote>
|
|
|
|
To ensure <code>boinc/py/</code> is in your python path:
|
|
<blockquote>
|
|
<code>import boinc_path_config</code>
|
|
</blockquote>
|
|
This is a special module that <code>configure</code> places in relevant
|
|
directories which then modifies <code>sys.path</code> appropriately.
|
|
|
|
<h2>Project-specific settings</h2>
|
|
The module <code>boinc_project_path</code> is imported to get the paths
|
|
for <code>config.xml</code> and <code>run_state.xml</code>. The default
|
|
paths for these are the parent directory of the invocation script. You can
|
|
override these defaults
|
|
<ol>
|
|
<li> modify this file directly (if you have only one project on your server
|
|
or have separate copies for each)
|
|
<li> create a new boinc_project_path.py and place it earlier in PYTHONPATH
|
|
than the default one
|
|
<li> define environment variables
|
|
</ol>
|
|
|
|
Example <code>boinc_project_path.py</code>
|
|
<pre>
|
|
config_xml_filename = '/etc/boinc/yetiathome/config.xml'
|
|
run_state_xml_filename = '/var/lib/boinc/yetiathome/run_state.xml'
|
|
</pre>
|
|
|
|
See the source of file <code>boinc/py/Boinc/boinc_project_path.py</code> for
|
|
details.
|
|
|
|
<h2>Directories containing python scripts</h2>
|
|
<table border=1 width=100%>
|
|
<tr><td><code>boinc/py/</code></td><td> <code>Boinc/*.py</code> </td> <td>
|
|
Main BOINC python modules
|
|
</td></tr>
|
|
<tr><td><code>boinc/sched/</code></td><td> <a href=tool_start.php><code>start</code></a> </td> <td>
|
|
BOINC start / Super Cron program
|
|
</td></tr>
|
|
<tr><td><code>boinc/tools/</code></td><td> <a href=tool_add.php><code>add</code></a> </td> <td>
|
|
Adds objects to the database.
|
|
TODO: document
|
|
</td></tr>
|
|
<tr><td><code>boinc/tools/</code></td><td> <a href=single_host_server.php><code>make_project</code></a> </td> <td>
|
|
Creates a project
|
|
</td></tr>
|
|
<tr><td><code>boinc/tools/</code></td><td> <a href=tool_update_versions.php><code>update_versions</code></a> </td> <td>
|
|
Adds all relevant core client and application executables to download
|
|
directory and database
|
|
</td></tr>
|
|
<tr><td><code>boinc/test/</code></td><td> <code>test*.py<br>cgiserver.py</code> </td> <td>
|
|
Test scripts: see the <a href=test.php>testing framework</a>.
|
|
</td></tr>
|
|
</table>
|
|
|
|
<h1>Python modules in <code>boinc/py/Boinc/</code></h1>
|
|
<table border=1>
|
|
<tr><td><code>boinc_path_config.py.in</code></td><td>
|
|
<code>Configure</code> puts <code>boinc_path_config.py</code> in all
|
|
directories that need it; see above
|
|
</td></tr>
|
|
<tr><td><code>boinc_project_path.py</code></td><td>
|
|
sets where <code>config.xml</code> et al can be found; see above.
|
|
</td></tr>
|
|
|
|
<tr><td><code>configxml.py</code></td><td>
|
|
reads and writes <code>config.xml</code> and <code>run_state.xml</code>
|
|
- see its pydoc for more information
|
|
</td></tr>
|
|
|
|
<tr><td><code>boinc_db.py</code></td><td>
|
|
auto-generated file that contains database constant definitions,
|
|
e.g. <code>RESULT_OUTCOME_SUCCESS = 1</code>
|
|
</td></tr>
|
|
|
|
<tr><td><code>setup_project.py</code></td><td>
|
|
internal module for creating a project. See <a href=
|
|
tool_make_project.php><code>make_project</code></a> and test scripts.
|
|
</td></tr>
|
|
|
|
<tr><td><code>database.py</code></td><td>
|
|
defines database backend functions and database operations; see below.
|
|
</td></tr>
|
|
<tr><td><code>db_mid.py</code></td><td>
|
|
"middle-end": optional mix-in to ease debugging by allowing printing of
|
|
database objects directly
|
|
</td></tr>
|
|
<tr><td><code>util.py</code></td><td>
|
|
miscellaneous functions
|
|
</td></tr>
|
|
<tr><td><code>version.py.in</code></td><td>
|
|
version and platform-specific definitions snarfed by <code>configure</code>
|
|
</td></tr>
|
|
|
|
</table>
|
|
|
|
<h1>Python database access</h1>
|
|
<code>Database.py</code> defines database backend library and database table
|
|
and object relationships to allow easy data manipulation.
|
|
<p>
|
|
|
|
All <a href=database.php>database tables</a> have a corresponding class and
|
|
its rows have classes, where each column is a member of that class. Ids are
|
|
automatically translated to and from objects. To begin, import
|
|
the <code>database</code> module:
|
|
<pre>
|
|
from Boinc import database
|
|
</pre>
|
|
|
|
Connect to the database:
|
|
<pre>
|
|
database.connect_default_config()
|
|
</pre>
|
|
|
|
Table classes can be indexed using the [ ] operator to retrieve an object by
|
|
id; e.g.
|
|
<pre>
|
|
# executes 'select * from project where id=1'.
|
|
# exception is raised if project is not found
|
|
project_with_id_1 = database.<b>Projects[1]</b>
|
|
</pre>
|
|
|
|
Table classes have a <code>find</code> function that builds and executes a
|
|
MySQL query based on its arguments:
|
|
<pre>
|
|
# this could return any number (0, 1, 2, ...) of platforms
|
|
# executes 'select * from platform where user_friendly_name="commodore 64"'
|
|
list_of_platforms_called_c64 = database.<b>Platforms.find(
|
|
user_friendly_name = 'Commodore 64')</b>
|
|
</pre>
|
|
|
|
Find can take any number of arguments; they are ANDed. For more advanced
|
|
usage such as custom SQL queries (anything is possible :) see the pydoc.
|
|
<pre>
|
|
all_apps = database.<b>Apps.find()</b>
|
|
finished_yeti_wus = database.<b>Workunits.find(
|
|
app = database.Apps.find(name='YETI@home')[0],
|
|
assimilate_state = ASSIMILATE_DONE)</b>
|
|
</pre>
|
|
|
|
Objects (table rows) have their column data as members so you can access and
|
|
modify them directly.
|
|
|
|
<pre>
|
|
user_quarl = database.users.find(email_addr='quarl@quarl.org')[0]
|
|
print "name =", <b>user_quarl.name</b>
|
|
<b>user_quarl.postal_code</b> = 97404
|
|
</pre>
|
|
|
|
To create a new database object, create a Python object and give all values
|
|
as parameters to the initializer:
|
|
<pre>
|
|
new_app = database.<B>App(</b>name='SPAGHETTI@home',
|
|
min_version=1,
|
|
create_time=time.time()<b>)</b>
|
|
</pre>
|
|
|
|
To commit any changes (including a new object), call <code>commit()</code>
|
|
(the tool <code>boinc/tools/add.py</code> is a command-line interface to
|
|
this):
|
|
<pre>
|
|
user_quarl<b>.commit()</b> # executes an UPDATE
|
|
new_app.<b>commit()</b> # executes an INSERT
|
|
</pre>
|
|
|
|
To remove an object, call <code>remove()</code>:
|
|
<pre>
|
|
team_eric_test = database.Teams(name="Eric's Test Team")[0]
|
|
team_eric_test<b>.remove()</b>
|
|
# OR
|
|
for team in database.Teams(name="Eric's Test Team"):
|
|
team.remove()
|
|
# OR
|
|
map(database.Team.remove,database.Teams(name="Eric's Test Team"))
|
|
</pre>
|
|
|
|
To access objects related by id, access the field name without "id" suffix:
|
|
(the <code>result</code> table has columns '<code>workunitid</code>' and
|
|
'<code>hostid</code>'; the <code>host</code> table has
|
|
column <code>userid</code>)
|
|
<pre>
|
|
wu_1234 = database.Workunits.find(name='1234.wu')[0]
|
|
results_of_wu_1234 = database.Results.find(<b>workunit=</b>wu_1234)
|
|
for result in results_of_wu_1234:
|
|
os.system("echo 'you are crunching %s' | mail '%s'" %(
|
|
result.name, <b>result.host.user</b>.email_addr))
|
|
</pre>
|
|
|
|
<table border=1 width=100%>
|
|
<tr><th>Table</th><th>Python table object</th><th>Python row object
|
|
class</th></tr>
|
|
<tr><td>project</td><td>Projects</td><td>Project</td></tr>
|
|
<tr><td>platform</td><td>Platforms</td><td>Platform</td></tr>
|
|
<tr><td>core_version</td><td>CoreVersions</td><td>CoreVersion</td></tr>
|
|
<tr><td>app</td><td>Apps</td><td>App</td></tr>
|
|
<tr><td>app_version</td><td>AppVersions</td><td>AppVersion</td></tr>
|
|
<tr><td>user</td><td>Users</td><td>User</td></tr>
|
|
<tr><td>team</td><td>Teams</td><td>Team</td></tr>
|
|
<tr><td>host</td><td>Hosts</td><td>Host</td></tr>
|
|
<tr><td>workunit</td><td>Workunits</td><td>Workunit</td></tr>
|
|
<tr><td>result</td><td>Results</td><td>Result</td></tr>
|
|
<tr><td>workseq</td><td>Workseqs</td><td>Workseq</td></tr>
|
|
</table>
|
|
|
|
<?
|
|
page_tail();
|
|
?>
|
|
|