-Web-based administrative interfaces
+Web-based participant interfaces
BOINC provides web-based interfaces for
account creation, preference editing, and participant status display.
@@ -92,6 +99,6 @@ making it easy to manage large numbers of hosts.
The core client downloads enough work to keep its host
busy for a user-specifiable amount of time.
-This allows the host to continue to function during project downtimes,
-and decreases the frequency of connections.
+This can be used to decrease the frequency of connections or to
+allow the host to keep working during project downtime.
diff --git a/doc/project.fig b/doc/project.fig
index c07f57f63f..b0ed72d355 100644
--- a/doc/project.fig
+++ b/doc/project.fig
@@ -84,28 +84,6 @@ Single
0 106 #868286
0 107 #c7c3c7
0 108 #e7e3e7
-6 3225 2625 4650 3300
-2 2 0 1 0 11 50 0 20 0.000 0 0 -1 0 0 5
- 3225 2625 4650 2625 4650 3300 3225 3300 3225 2625
-4 0 0 50 0 18 14 0.0000 4 210 1155 3375 2925 scheduling\001
-4 0 0 50 0 18 14 0.0000 4 120 660 3600 3150 server\001
--6
-6 4950 3675 5925 4950
-5 1 0 1 -1 -1 0 0 -1 0.000 0 1 0 0 5400.000 4125.000 4950 4725 5400 4875 5850 4725
-1 2 0 1 -1 11 0 0 20 0.000 1 0.0000 5421 3894 450 150 4971 3894 5871 3894
-2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 0 0 2
- 4950 3900 4950 4725
-2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 0 0 2
- 5850 3975 5850 4725
-4 1 -1 0 0 18 12 0.0000 6 135 600 5400 4350 BOINC\001
-4 1 -1 0 0 18 12 0.0000 6 135 270 5400 4575 DB\001
--6
-6 7650 750 8775 1500
-2 2 0 1 0 7 50 0 -1 0.000 0 0 -1 0 0 5
- 7650 750 8775 750 8775 1500 7650 1500 7650 750
-4 0 0 50 0 18 14 0.0000 4 120 780 7800 1350 servers\001
-4 0 0 50 0 18 14 0.0000 4 165 450 7950 1050 data\001
--6
6 2100 4050 2775 4800
2 1 0 1 0 3 50 0 20 0.000 0 0 -1 1 0 2
0 0 1.00 60.00 120.00
@@ -118,24 +96,34 @@ Single
2400 5550 2400 6075
4 0 0 50 0 16 14 0.0000 4 165 510 2100 5475 client\001
-6
-6 4800 2625 6225 3300
+6 3225 4050 4650 4725
2 2 0 1 0 11 50 0 20 0.000 0 0 -1 0 0 5
- 4800 2625 6225 2625 6225 3300 4800 3300 4800 2625
-4 0 0 50 0 18 14 0.0000 4 210 585 5175 2925 utility\001
-4 0 0 50 0 18 14 0.0000 4 165 1005 5025 3150 programs\001
+ 3225 4050 4650 4050 4650 4725 3225 4725 3225 4050
+4 0 0 50 0 18 14 0.0000 4 210 1155 3375 4350 scheduling\001
+4 0 0 50 0 18 14 0.0000 4 120 660 3600 4575 server\001
-6
-6 6375 2625 7800 3300
+6 6975 3975 8100 4725
+2 2 0 1 0 7 50 0 -1 0.000 0 0 -1 0 0 5
+ 6975 3975 8100 3975 8100 4725 6975 4725 6975 3975
+4 0 0 50 0 18 14 0.0000 4 120 780 7125 4575 servers\001
+4 0 0 50 0 18 14 0.0000 4 165 450 7275 4275 data\001
+-6
+6 8475 4050 9900 4725
2 2 0 1 0 11 50 0 20 0.000 0 0 -1 0 0 5
- 6375 2625 7800 2625 7800 3300 6375 3300 6375 2625
-4 0 0 50 0 18 14 0.0000 4 165 465 6900 2925 Web\001
-4 0 0 50 0 18 14 0.0000 4 165 1020 6600 3150 interfaces\001
+ 8475 4050 9900 4050 9900 4725 8475 4725 8475 4050
+4 0 0 50 0 18 14 0.0000 4 165 465 9000 4350 Web\001
+4 0 0 50 0 18 14 0.0000 4 165 1020 8700 4575 interfaces\001
+-6
+6 5175 2175 6150 3450
+5 1 0 1 -1 -1 0 0 -1 0.000 0 1 0 0 5625.000 2625.000 5175 3225 5625 3375 6075 3225
+1 2 0 1 -1 11 0 0 20 0.000 1 0.0000 5646 2394 450 150 5196 2394 6096 2394
+2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 0 0 2
+ 5175 2400 5175 3225
+2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 0 0 2
+ 6075 2475 6075 3225
+4 1 -1 0 0 18 12 0.0000 6 135 600 5625 2850 BOINC\001
+4 1 -1 0 0 18 12 0.0000 6 135 270 5625 3075 DB\001
-6
-2 2 0 1 0 30 50 0 20 0.000 0 0 -1 0 0 5
- 3600 750 6900 750 6900 1500 3600 1500 3600 750
-2 1 0 1 0 3 50 0 20 0.000 0 0 -1 1 1 2
- 0 0 1.00 60.00 120.00
- 0 0 1.00 60.00 120.00
- 3900 3300 3900 7200
2 2 0 1 0 30 50 0 20 0.000 0 0 -1 0 0 5
9825 750 10350 750 10350 1200 9825 1200 9825 750
2 2 0 1 0 11 50 0 20 0.000 0 0 -1 0 0 5
@@ -154,30 +142,34 @@ Single
3600 7200 8850 7200 8850 8100 3600 8100 3600 7200
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
0 0 1.00 60.00 120.00
- 8250 7200 8250 1500
+ 7575 7200 7575 4725
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
- 1 1 1.00 60.00 120.00
- 4350 3300 4950 3750
+ 0 0 1.00 60.00 120.00
+ 9900 6225 9225 4725
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
- 1 1 1.00 60.00 120.00
- 5400 3300 5400 3675
+ 0 0 1.00 60.00 120.00
+ 3900 7200 3900 4725
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
- 1 1 1.00 60.00 120.00
- 6825 3300 6000 3750
+ 0 0 1.00 60.00 120.00
+ 4200 4050 5325 3300
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
- 1 1 1.00 60.00 120.00
- 6309 1488 7125 2625
+ 0 0 1.00 60.00 120.00
+ 8850 4050 6075 3225
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
- 1 1 1.00 60.00 120.00
- 5409 1488 5400 2625
+ 0 0 1.00 60.00 120.00
+ 5625 1650 5625 2250
+2 2 0 1 0 11 50 0 20 0.000 0 0 -1 0 0 5
+ 4350 1200 7650 1200 7650 1650 4350 1650 4350 1200
+2 2 0 1 0 30 50 0 20 0.000 0 0 -1 0 0 5
+ 4350 750 7650 750 7650 1200 4350 1200 4350 750
2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2
- 1 1 1.00 60.00 120.00
- 10081 6123 7500 3300
-4 0 0 50 0 18 14 0.0000 4 210 1740 4350 1275 project back end\001
+ 0 0 1.00 60.00 120.00
+ 6825 1650 7500 4050
4 0 0 50 0 16 14 0.0000 4 210 2775 10500 1200 project-specific components\001
4 0 0 50 0 16 14 0.0000 4 210 1920 10500 1800 BOINC components\001
4 0 0 50 0 18 14 0.0000 4 210 1785 4751 6000 application client\001
4 0 0 50 0 18 14 0.0000 4 165 990 4981 6600 client API\001
4 0 0 50 0 18 14 0.0000 4 165 1095 5550 7725 core client\001
-4 0 0 50 0 18 14 0.0000 4 210 2355 2100 2400 BOINC server complex\001
4 0 0 50 0 18 14 0.0000 4 210 1245 9450 6525 participants\001
+4 0 0 50 0 18 14 0.0000 4 210 2355 2325 3675 BOINC server complex\001
+4 0 0 50 0 18 14 0.0000 4 210 1740 2400 900 project back end\001
diff --git a/doc/project.png b/doc/project.png
index 68f367109f..9822a6c2b2 100644
Binary files a/doc/project.png and b/doc/project.png differ
diff --git a/doc/work_states.html b/doc/work_states.html
new file mode 100644
index 0000000000..9bf7dcaa21
--- /dev/null
+++ b/doc/work_states.html
@@ -0,0 +1,80 @@
+Workunit and result states
+Workunit and result states
+
+
+The processing of workunits and results involves
+several independent activities.
+To keep track of these activities,
+workunit and result database records have several "state" fields,
+and their processing can be viewed as the combination
+of several finite-state machines.
+
+
+A workunit has the following state fields:
+
+-
+main_state:
+Initially INIT.
+If a canonical result is found (by validate)
+it transitions to DONE.
+If it's decided that no canonical result can be found
+(by result_retry)
+it transitions to ERROR.
+
+
-
+file_delete_state:
+Initially INIT.
+When the main state transitions to either DONE or ERROR,
+it transitions to READY,
+indicating that input files can be deleted.
+When file deletion is completed (by file_deleter)
+it transitions to DONE.
+
+
-
+assimilate_state:
+Initially INIT.
+When the main state transitions to either DONE or ERROR,
+it transitions to READY,
+indicating that the workunit can be assimilated.
+When assimplateion is completed (by assimilator)
+it transitions to DONE.
+
+
-
+need_validate:
+A boolean, true whenever
+the workunit has a result whose validate state is NEED_CHECK.
+The validate program sets it back to false.
+
+
+
+
+
+
+A result has the following state fields:
+
+-
+server_state:
+Initially UNSENT.
+Becomes IN_PROGRESS when the result has been sent to a client.
+Becomes DONE or ERROR if the client returns the result,
+or TIMEOUT if result_retry gives up on the result.
+
-
+client_state:
+Records the client state (upload, process, or download)
+where an error occurred.
+Not relevant here.
+
-
+file_delete_state:
+Initially INIT.
+When the parent workunit becomes ERROR, becomes READY,
+indication that the output files can be deleted.
+When the parent workunit becomes DONE, becomes READY
+except for the canonical result, which remains INIT.
+When the output files have been deleted (by file_deleter) becomes DONE.
+
-
+validate_state:
+Initially INITIAL.
+When the result is returned, becomes NEED_CHECK.
+When a canonical result has been found for the workunit,
+becomes either VALID or INVALID.
+
diff --git a/html/ops/db.inc b/html/ops/db.inc
index 57c1cb1a33..32390ff700 100644
--- a/html/ops/db.inc
+++ b/html/ops/db.inc
@@ -37,8 +37,8 @@ function show_platform($platform) {
start_table();
row("ID", $platform->id);
row("Created", time_str($platform->create_time));
- row("Platform Name", $platform->name);
- row("","id>Application Versions for Platform $platform->name ");
+ row("Name", $platform->name);
+ row("","id>App versions for this platform");
end_table();
}
@@ -46,9 +46,9 @@ function show_app($app) {
start_table();
row("ID", $app->id);
row("Created", time_str($app->create_time));
- row("Application Name", $app->name);
- row("","id>Application Versions for Application $app->name");
- row("","id>Workunits for this Application");
+ row("Name", $app->name);
+ row("","id>App Versions for this application");
+ row("","id>Workunits for this application");
end_table();
}
@@ -109,9 +109,17 @@ function show_host($host) {
}
-function retry_state_str($s) {
+function main_state_str($s) {
switch($s) {
- case 0: return "Default";
+ case 0: return "Initial";
+ case 1: return "Done";
+ case 2: return "Error";
+ }
+}
+
+function error_str($s) {
+ switch($s) {
+ case 0: return "No error";
case 1: return "Send failed";
case 2: return "Too many errors (may have bug)";
case 3: return "Too many done (may be nondeterministic)";
@@ -119,6 +127,22 @@ function retry_state_str($s) {
return "unknown";
}
+function assimilate_state_str($s) {
+ switch($s) {
+ case 0: return "Initial";
+ case 1: return "Ready to assimilate";
+ case 2: return "Assimilated";
+ }
+}
+
+function file_delete_state_str($s) {
+ switch($s) {
+ case 0: return "Initial";
+ case 1: return "Ready to delete";
+ case 2: return "Deleted";
+ }
+}
+
function show_workunit($wu,$show_xml_doc) {
start_table();
row("Created", time_str($wu->create_time));
@@ -136,8 +160,11 @@ function show_workunit($wu,$show_xml_doc) {
row("Canonical resultid", $wu->canonical_resultid);
row("Canonical credit", $wu->canonical_credit);
row("Retry check time", time_str($wu->retry_check_time));
- row("Retry state", retry_state_str($wu->state));
row("Delay bound", $wu->delay_bound);
+ row("Main state", main_state_str($wu->main_state));
+ row("Error", error_str($wu->error));
+ row("File delete state", file_delete_state_str($wu->file_delete_state));
+ row("Assimilation state", assimilate_state_str($wu->assimilate_state));
row("","id>Show associated results");
end_table();
echo "";
@@ -168,16 +195,16 @@ function validate_state_str($s) {
function show_result($result,$show_xml_docs,$show_stderr,$show_times) {
start_table();
if ($show_times) {
- row("created", time_str($result->create_time));
- row("sent", time_str($result->sent_time));
- row("received", time_str($result->received_time));
+ row("Created", time_str($result->create_time));
+ row("Sent", time_str($result->sent_time));
+ row("Received", time_str($result->received_time));
}
row("Name", $result->name);
row("Workunit", "workunitid>" . wu_name_by_id($result->workunitid) . "" );
- row("state", res_state_string($result->server_state));
+ row("Server state", res_state_string($result->server_state));
row("Deadline", time_str($result->report_deadline));
row("Host ID", "hostid>" . host_name_by_id($result->hostid) . "");
- row("Client_state: ", $result->client_state);
+ row("Client state", $result->client_state);
row("CPU time", $result->cpu_time);
if ($show_xml_docs) {
row("XML doc in", "
".htmlspecialchars($result->xml_doc_in)."
");
@@ -186,42 +213,42 @@ function show_result($result,$show_xml_docs,$show_stderr,$show_times) {
if ($show_stderr) {
row("stderr out", "".htmlspecialchars($result->stderr_out)."
");
}
- row("batch", $result->batch);
- row("project state", $result->project_state);
+ row("Batch", $result->batch);
+ row("File delete state", file_delete_state_str($result->file_delete_state));
row("Validate state", validate_state_str($result->validate_state));
row("claimed credit", $result->claimed_credit);
- row("granted credit", $result->granted_credit);
+ row("Granted credit", $result->granted_credit);
end_table();
echo "";
}
function show_user($user) {
start_table();
- row("created", time_str($user->create_time));
- row("total credit", $user->total_credit);
- row("recent averaged credit:", $user->expavg_credit);
- row("name", $user->name);
- row("email address", $user->email_addr);
- row("country", $user->country);
- row("postal code", $user->postal_code);
- row("total credit", $user->total_credit);
- row("average credit", $user->expavg_credit);
- row("last average time", time_str($user->expavg_time));
+ row("Created", time_str($user->create_time));
+ row("Total credit", $user->total_credit);
+ row("Recent averaged credit:", $user->expavg_credit);
+ row("Name", $user->name);
+ row("Email address", $user->email_addr);
+ row("Country", $user->country);
+ row("Postal code", $user->postal_code);
+ row("Total credit", $user->total_credit);
+ row("Average credit", $user->expavg_credit);
+ row("Last average time", time_str($user->expavg_time));
end_table();
}
function team_type_string($s) {
switch ($s) {
- case 1: return "Small Company";
- case 2: return "Medium Company";
- case 3: return "Large Company";
- case 4: return "Club";
- case 5: return "Primary School";
- case 6: return "Secondary School";
- case 7: return "Junior College";
- case 8: return "University or Department";
- case 9: return "Government Agency";
- default: return "Unknown";
+ case 1: return "Small Company";
+ case 2: return "Medium Company";
+ case 3: return "Large Company";
+ case 4: return "Club";
+ case 5: return "Primary School";
+ case 6: return "Secondary School";
+ case 7: return "Junior College";
+ case 8: return "University or Department";
+ case 9: return "Government Agency";
+ default: return "Unknown";
}
}
diff --git a/html/user/user.inc b/html/user/user.inc
index af9624bba5..866bf9b8fe 100644
--- a/html/user/user.inc
+++ b/html/user/user.inc
@@ -1,10 +1,11 @@
".TD2.LG_FONT."User Stats:\n";
- row("User Name: ", $user->name);
- $row = sprintf("%s user since: ", $project);
+ row("Name: ", $user->name);
+ $row = sprintf("%s Participant since: ", $project);
row($row, time_str($user->create_time));
row("Total credit: ", $user->total_credit);
row("Recent average credit: ", $user->expavg_credit);
@@ -18,6 +19,8 @@ function show_user_stats($user) {
echo "\n";
}
+// show private user info
+//
function show_user_profile($user) {
echo TABLE2."\n";
echo "
".TD2.LG_FONT."User Information:
\n";
@@ -48,10 +51,10 @@ function show_hosts($user) {
function show_host_brief($host) {
echo "
- | id>$host->domain_name |
- $host->total_credit |
- $host->expavg_credit |
-
";
+ id>$host->domain_name |
+ $host->total_credit |
+ $host->expavg_credit |
+ ";
}
// show a summary of the user.
diff --git a/sched/assimilator.C b/sched/assimilator.C
index 6d14c464d4..5bc81c4128 100644
--- a/sched/assimilator.C
+++ b/sched/assimilator.C
@@ -10,14 +10,15 @@ CONFIG config;
// return nonzero if did anything
//
-bool do_pass() {
+bool do_pass(APP app) {
WORKUNIT wu;
RESULT result;
bool did_something = false;
int retval;
+ wu.appid = app.id;
wu.assimilate_state = ASSIMILATE_READY;
- while (db_workunit_enum_assimilate_state(wu)) {
+ while (!db_workunit_enum_app_assimilate_state(wu)) {
did_something = true;
switch(wu.main_state) {
case WU_MAIN_STATE_INIT:
@@ -50,6 +51,7 @@ bool do_pass() {
int main(int argc, char** argv) {
int retval;
bool asynch = false, one_pass = false;
+ APP app;
int i;
for (i=1; i", filename, sizeof(filename))) {
- continue;
} else if (match_tag(p, "")) {
no_delete = false;
strcpy(filename, "");
@@ -27,9 +25,11 @@ int wu_delete_files(WORKUNIT& wu) {
} else if (match_tag(p, "")) {
if (!no_delete) {
sprintf(pathname, "%s/%s", config.download_dir, filename);
+ printf("deleting %s\n", pathname);
unlink(pathname);
}
}
+ p = strtok(0, "\n");
}
return 0;
}
@@ -41,9 +41,7 @@ int result_delete_files(RESULT& result) {
p = strtok(result.xml_doc_in, "\n");
while (p) {
- p = strtok(0, "\n");
if (parse_str(p, "", filename, sizeof(filename))) {
- continue;
} else if (match_tag(p, "")) {
no_delete = false;
strcpy(filename, "");
@@ -52,9 +50,11 @@ int result_delete_files(RESULT& result) {
} else if (match_tag(p, "")) {
if (!no_delete) {
sprintf(pathname, "%s/%s", config.upload_dir, filename);
+ printf("deleting %s\n", pathname);
unlink(pathname);
}
}
+ p = strtok(0, "\n");
}
return 0;
}
@@ -67,7 +67,7 @@ bool do_pass() {
bool did_something = false;
wu.file_delete_state = FILE_DELETE_READY;
- while (db_workunit_enum_file_delete_state(wu)) {
+ while (!db_workunit_enum_file_delete_state(wu)) {
did_something = true;
wu_delete_files(wu);
wu.file_delete_state = FILE_DELETE_DONE;
@@ -75,7 +75,7 @@ bool do_pass() {
}
result.file_delete_state = FILE_DELETE_READY;
- while (db_result_enum_file_delete_state(result)) {
+ while (!db_result_enum_file_delete_state(result)) {
did_something = true;
result_delete_files(result);
result.file_delete_state = FILE_DELETE_DONE;
diff --git a/sched/handle_request.C b/sched/handle_request.C
index efdeac106a..db792dfd32 100644
--- a/sched/handle_request.C
+++ b/sched/handle_request.C
@@ -363,9 +363,6 @@ int handle_results(
if (retval) {
fprintf(stderr, "Can't update WU\n");
}
- fprintf(stderr,
- "BOINC scheduler: set need_validate for WU %d\n", wu.id
- );
}
}
}
diff --git a/test/test.inc b/test/test.inc
index b1f50374a7..42bcd0d56f 100644
--- a/test/test.inc
+++ b/test/test.inc
@@ -248,6 +248,8 @@ class Project {
PassThru("cp $source_dir/sched/feeder $this->project_dir/cgi/");
PassThru("cp $source_dir/sched/result_retry $this->project_dir/cgi/");
PassThru("cp $source_dir/sched/validate_test $this->project_dir/cgi/");
+ PassThru("cp $source_dir/sched/file_deleter $this->project_dir/cgi/");
+ PassThru("cp $source_dir/sched/assimilator $this->project_dir/cgi/");
PassThru("cp $source_dir/html_ops/stripchart.cgi $this->project_dir/cgi/");
$f = fopen("$this->project_dir/cgi/config.xml", "w");
fputs($f, "\n");
@@ -420,6 +422,18 @@ class Project {
PassThru("cd $this->project_dir/cgi; ./validate_test -one_pass -app $app->name -quorum $quorum > validate_out");
}
+ // do one pass of file_deleter
+ //
+ function file_delete() {
+ PassThru("cd $this->project_dir/cgi; ./file_deleter -one_pass > file_deleter_out");
+ }
+
+ // do one pass of assimilator
+ //
+ function assimilate($app) {
+ PassThru("cd $this->project_dir/cgi; ./assimilator -one_pass -app $app->name > assimilator_out");
+ }
+
// this should stop the feeder and any other daemons
//
function stop() {
diff --git a/test/test_uc.php b/test/test_uc.php
index 10037d4099..8a6d506ad3 100644
--- a/test/test_uc.php
+++ b/test/test_uc.php
@@ -49,4 +49,9 @@
$project->check_results(2, $result);
$project->compare_file("uc_wu_0_0", "uc_correct_output");
$project->compare_file("uc_wu_1_0", "uc_correct_output");
+
+ $project->file_delete();
+ // input file should be gone here
+ $project->assimilate($app);
+ $project->file_delete();
?>
diff --git a/todo b/todo
index 90d632551f..a2bd90ff19 100755
--- a/todo
+++ b/todo
@@ -1,36 +1,130 @@
-write garbage collector
-
-prevent 2 core clients from running at once
-
-support for HTTP and SOCKS proxies
+-----------------------
+HIGH-PRIORITY (should do for beta test)
+-----------------------
make get_local_ip_addr() work in all cases
est_time_to_completion doesn't work for non-running tasks
-get timezone working on all platforms
-get benchmark working as separate process
- must do this before send first scheduler request
-validate in crontab
+run backend programs (validate/file_deleter/assimilate)
+ from crontab; document
Windows client
make mini-logo
fix "unable to calculate"
completed results: show final CPU time
+
+Messages from core client
+ decide what messages should be shown to user, and how
+ log file? GUI? dialog?
+
+-----------------------
+MEDIUM-PRIORITY (should do before public release)
-----------------------
-use https for login (don't sent account ID or password in clear)
-
protect project admin web pages (htaccess)
+get timezone working on all platforms
Deadline mechanism for results
- use in result dispatching
- use in file uploading (decide what to upload next)
- use in deciding when to make scheduler RPC (done already?)
-create "result adder" program that detects WUs that don't have
- a canonical result yet, and should,
- and creates more results for them.
- This should detect situations where we're getting lots
- of error results, and skip over those WUs
+Testing framework
+ better mechanisms to model server/client/communication failure
+ better mechanisms to simulate large load
+ do client/server on separate hosts?
+
+Delete files if needed to honor disk usage constraint
+ inform user if this happens
+
+implement max bytes/sec network preferences
+
+Global preferences
+ implement disk usage prefs
+ time-of-day prefs?
+ test propagation mechanism
+ set up multi-project, multi-host test;
+ change global prefs at one web site,
+ make sure they propagate to all hosts
+ limit on frequency of disk writes?
+ max net traffic per day?
+ implement in client
+
+Per-project preferences
+ test project-specific prefs
+ make example web edit pages
+ make app that uses them
+ set up a test with multiple projects
+ test "add project" feature, GUI and cmdline
+ test resource share mechanism
+
+CPU benchmarking
+ review CPU benchmarks - do they do what we want?
+ what to do when tests show hardware problem?
+ How should we weight factors for credit?
+ run CPU tests unobtrusively, periodically
+ check that on/conn/active fracs are maintainted correctly
+ check that bandwidth is measured correctly
+ measure disk/mem size on all platforms
+ get timezone to work
+
+CPU accounting in the presence of checkpoint/restart
+ test
+
+Test nslots > 1
+
+Redundancy checking and validation
+ test the validation mechanism
+ make sure credit is granted correctly
+ make sure average, total credit maintained correctly for user, host
+
+Windows screensaver functionality
+ idle-only behavior without screensaver - test
+
+Data transfer
+ make sure restart of downloads works
+ make sure restart of uploads works
+ test download/upload with multiple data servers
+ make sure it tries servers in succession,
+ does exponential backoff if all fail
+ review and document prioritization of transfers
+ review protocol; make sure error returns are possible and handled correctly
+
+Scheduler
+ Should dispatch results based on deadline?
+ test that scheduler estimates WU completion time correctly
+ test that scheduler sends right amount of work
+ test that client estimates remaining work correctly,
+ requests correct # of seconds
+ test that hi/low water mark system works
+ test that scheduler sends only feasible WUs
+
+Scheduler RPC
+ formalize notion of "permanent failure" (e.g. can't download file)
+ report perm failures to scheduler, record in DB
+ make sure RPC backoff is done for any perm failure
+ (in general, should never make back-to-back RPCs to a project)
+ make sure that client eventually reloads master URL
+
+Application graphics
+ finish design, implementation, doc, testing
+ size, frame rate, whether to generate
+
+Work generation
+ generation of upload signature is very slow
+
+prevent file_xfer->req1 from overflowing. This problems seems to be
+ happening when the file_upload_handler returnes a message to the
+ client that is large. This causes project->parsefile to get wrong
+ input and so on.
+
+test HTTP redirect mechanism for all types of ops
+
+Add batch features to ops web
+-----------------------
+LONG-TERM IDEAS AND PROJECTS
+-----------------------
+
+use https for login (don't sent account ID or password in clear)
CPU benchmarking
This should be done by a pseudo-application
@@ -40,14 +134,6 @@ CPU benchmarking
benchmarking programs (e.g. for graphics coprocessor)
or project-specific programs.
-Testing framework
- better mechanisms to model server/client/communication failure
- better mechanisms to simulate large load
- do client/server on separate hosts?
-
-Add "garbage-collect state" fields to WU, result
- whether deletion of files is OK, is done
-
investigate binary diff mechanism for updating persistent files
verify support for > 4 GB files everywhere
@@ -55,11 +141,6 @@ verify support for > 4 GB files everywhere
use FTP instead of HTTP for file xfer??
measure speed diff
-Delete files if needed to honor disk usage constraint
- inform user if this happens
-
-implement max bytes/sec network preferences
-
Local scheduling
more intelligent decision about when/what to work on
- monitor VM situation, run small-footprint programs
@@ -85,99 +166,12 @@ Include account ID in URL for file xfers
This would let you verify network xfers by scanning web logs
(could use that to give credit for xfers)
-Global preferences
- implement disk usage prefs
- time-of-day prefs?
- test propagation mechanism
- set up multi-project, multi-host test;
- change global prefs at one web site,
- make sure they propagate to all hosts
- limit on frequency of disk writes?
- max net traffic per day?
- implement in client
-
-Per-project preferences
- test project-specific prefs
- make example web edit pages
- make app that uses them
- set up a test with multiple projects
- test "add project" feature, GUI and cmdline
- test resource share mechanism
-
-Proxies
- work through HTTP, Socks proxies
- look at other open-source code (Mozilla?)
-
-Documentation
- simplify/finish docs on server installation
- get rid of text in INSTALL and INSTALL_CLIENT;
- they should just refer to .html files
-
-Testing in general
- figure out how to set up multi-project, multi-host tests
- from a single script
- automate some simple test cases
-
-Messages from core client
- decide what messages should be shown to user, and how
- log file? GUI? dialog?
-
-CPU benchmarking
- review CPU benchmarks - do they do what we want?
- what to do when tests show hardware problem?
- How should we weight factors for credit?
- run CPU tests unobtrusively, periodically
- check that on/conn/active fracs are maintainted correctly
- check that bandwidth is measured correctly
- measure disk/mem size on all platforms
- get timezone to work
-
WU/result sequence mechanism
design/implement/document
Multiple application files
document, test
-CPU accounting in the presence of checkpoint/restart
- test
-
-Test nslots > 1
-
-Redundancy checking and validation
- test the validation mechanism
- make sure credit is granted correctly
- make sure average, total credit maintained correctly for user, host
-
-Scheduler RPC
- formalize notion of "permanent failure" (e.g. can't download file)
- report perm failures to scheduler, record in DB
- make sure RPC backoff is done for any perm failure
- (in general, should never make back-to-back RPCs to a project)
- make sure that client eventually reloads master URL
-
-Data transfer
- make sure restart of downloads works
- make sure restart of uploads works
- test download/upload with multiple data servers
- make sure it tries servers in succession,
- does exponential backoff if all fail
- review and document prioritization of transfers
- review protocol; make sure error returns are possible and handled correctly
-
-Application graphics
- finish design, implementation, doc, testing
- size, frame rate, whether to generate
-
-Work generation
- generation of upload signature is very slow
-
-Windows GUI
- finish design/implement
- display credit info, team
-
-Windows screensaver functionality
- idle-only behavior without screensaver - test
-
Versioning
think through issues involved in:
compatibility of core client and scheduling server
@@ -187,29 +181,10 @@ Versioning
Need version numbers for protocols/interfaces?
What messages to show user? Project?
-Scheduler
- Should dispatch results based on deadline?
- test that scheduler estimates WU completion time correctly
- test that scheduler sends right amount of work
- test that client estimates remaining work correctly,
- requests correct # of seconds
- test that hi/low water mark system works
- test that scheduler sends only feasible WUs
-
Persistent files
test
design/implement test reporting, retrieval mechanisms
(do this using WU/results with null application?)
-User HTML
- leader boards
-
NET_XFER_SET
review logic; prevent one stream for starving others
-
-test HTTP redirect mechanism for all types of ops
-
-prevent file_xfer->req1 from overflowing. This problems seems to be
-happening when the file_upload_handler returnes a message to the
-client that is large. This causes project->parsefile to get wrong
-input and so on.
+