hydrus/help/getting_started_subscriptio...

<html>
	<head>
		<title>getting started - subscriptions</title>
		<link href="hydrus.ico" rel="shortcut icon" />
		<link href="style.css" rel="stylesheet" type="text/css" />
	</head>
	<body>
		<div class="content">
			<p><a href="getting_started_tags.html"><--- Back to tags</a></p>
			<h3>what are subs?</h3>
			<p>Subscriptions are a way of telling the client to regularly check a particular web search. Any new files will be downloaded and imported, and their tags optionally parsed.</p>
			<p>You can set up a subscription for any of the gallery websites in the normal <i>new page->download->gallery</i> menu.</p>
			<p>Here's the dialog, which is under <i>services->manage subscriptions</i>:</p>
			<p><img src="subs_dialog.png" /></p>
			<p>Here I have one subscription for Deviant Art, for the artist ChaoyuanXu. The client is set to check this artist for new files every seven days. It will parse <i>creator</i> and <i>title</i> tags and pend them to the tag repository called 'public tag repo'.</p>
			<p>This works very like hydrus repository synchronisation, in the background, reporting its progress in the middle of the status bar at the bottom of the main window, like so:</p>
			<p><img src="subs_status.png" /></p>
			<p>You don't really have to care about this all that much; it just lets you know what it is doing.</p>
			<p>Serious errors, like server 404s, are recovered from as gracefully as possible. The client will retry those subscriptions the next day.</p>
			<p>Here's the result of the subscription I set up above:</p>
			<p><img src="subs_import_done.png" /></p>
			<p>It took about two minutes to download all that, and it all happened quietly in the background. Notice the 146 pending tags, up top.</p>
			<h3>how could this possibly go wrong?</h3>
			<p>This is quite a powerful tool, and if you are silly, you will end up spamming a server and likely upsetting someone or breaking something.</p>
			<p>To initialise a subscription, the client will parse every single currently existing gallery and image page for that particular search. This is fine for the example above, which had 4 gallery pages and 73 image pages, but the search "short hair" on safebooru has about 6,400 gallery pages encompassing >250,000 results! Trying a search like that will take a tremendous amount of time for you and cause a non-trivial CPU and data hit to their server.</p>
			<p><i>Remember: If you are going to scrape anything from a site, be polite about it!</i></p>
			<p>So, I advise you start with artist searches to begin with. These usually top out at about 1,000 files, and hence don't take all that long. Once you are more confident, try doing multiple-tag queries. I suggest you leave simple single-tag queries for the manual download page, where you can hit 'that's enough' after ten or twenty pages.</p>
			<h3>help! it won't stop!</h3>
			<p>If you <i>do</i> put in a huge search, and the 'found x new files for subscription y' message is climbing terrifyingly higher and higher with no end in sight, you can pause the subscriptions daemon with <i>services->pause->subscriptions synchronisation</i>.</p>
			<p>This will give you a breather to reedit your subscriptions in the dialog. Remember to unpause when you are done.</p>
			<p class="right"><a href="index.html">Go back to the index ---></a></p>
		</div>
	</body>
</html>
Version 67 2013-04-24 21:23:53 +00:00			`<html>`
			`<head>`
			`<title>getting started - subscriptions</title>`
			`<link href="hydrus.ico" rel="shortcut icon" />`
			`<link href="style.css" rel="stylesheet" type="text/css" />`
			`</head>`
			`<body>`
			`<div class="content">`
			`<p><a href="getting_started_tags.html"><--- Back to tags</a></p>`
			`<h3>what are subs?</h3>`
			`<p>Subscriptions are a way of telling the client to regularly check a particular web search. Any new files will be downloaded and imported, and their tags optionally parsed.</p>`
			`<p>You can set up a subscription for any of the gallery websites in the normal <i>new page->download->gallery</i> menu.</p>`
			`<p>Here's the dialog, which is under <i>services->manage subscriptions</i>:</p>`
			`<p><img src="subs_dialog.png" /></p>`
Version 96 2013-12-11 22:09:25 +00:00			`<p>Here I have one subscription for Deviant Art, for the artist ChaoyuanXu. The client is set to check this artist for new files every seven days. It will parse <i>creator</i> and <i>title</i> tags and pend them to the tag repository called 'public tag repo'.</p>`
			`<p>This works very like hydrus repository synchronisation, in the background, reporting its progress in the middle of the status bar at the bottom of the main window, like so:</p>`
Version 67 2013-04-24 21:23:53 +00:00			`<p><img src="subs_status.png" /></p>`
			`<p>You don't really have to care about this all that much; it just lets you know what it is doing.</p>`
Version 119 2014-06-18 21:53:48 +00:00			`<p>Serious errors, like server 404s, are recovered from as gracefully as possible. The client will retry those subscriptions the next day.</p>`
Version 67 2013-04-24 21:23:53 +00:00			`<p>Here's the result of the subscription I set up above:</p>`
			`<p><img src="subs_import_done.png" /></p>`
			`<p>It took about two minutes to download all that, and it all happened quietly in the background. Notice the 146 pending tags, up top.</p>`
			`<h3>how could this possibly go wrong?</h3>`
			`<p>This is quite a powerful tool, and if you are silly, you will end up spamming a server and likely upsetting someone or breaking something.</p>`
Version 119 2014-06-18 21:53:48 +00:00			`<p>To initialise a subscription, the client will parse every single currently existing gallery and image page for that particular search. This is fine for the example above, which had 4 gallery pages and 73 image pages, but the search "short hair" on safebooru has about 6,400 gallery pages encompassing >250,000 results! Trying a search like that will take a tremendous amount of time for you and cause a non-trivial CPU and data hit to their server.</p>`
Version 96 2013-12-11 22:09:25 +00:00			`<p><i>Remember: If you are going to scrape anything from a site, be polite about it!</i></p>`
			`<p>So, I advise you start with artist searches to begin with. These usually top out at about 1,000 files, and hence don't take all that long. Once you are more confident, try doing multiple-tag queries. I suggest you leave simple single-tag queries for the manual download page, where you can hit 'that's enough' after ten or twenty pages.</p>`
Version 67 2013-04-24 21:23:53 +00:00			`<h3>help! it won't stop!</h3>`
			`<p>If you <i>do</i> put in a huge search, and the 'found x new files for subscription y' message is climbing terrifyingly higher and higher with no end in sight, you can pause the subscriptions daemon with <i>services->pause->subscriptions synchronisation</i>.</p>`
Version 119 2014-06-18 21:53:48 +00:00			`<p>This will give you a breather to reedit your subscriptions in the dialog. Remember to unpause when you are done.</p>`
Version 67 2013-04-24 21:23:53 +00:00			`<p class="right"><a href="index.html">Go back to the index ---></a></p>`
			`</div>`
			`</body>`
			`</html>`