Commit Graph

27 Commits

Author SHA1 Message Date
Nemo 03fccde754 Adds support for final journal downloads 2020-06-30 18:36:01 +05:30
Nemo 62e6a21c84 Finishes support for downloading complete issues 2020-06-30 17:36:44 +05:30
Nemo 870ed3080d Modular code in fetch to support both chapters and articles 2020-06-30 14:47:51 +05:30
Nemo f04e9b799e Removes input_pdf and initial work on article download 2020-06-30 14:18:19 +05:30
Nemo 04a2fe52ec Minor fixes, parse contents for issues 2020-06-30 14:08:28 +05:30
Nemo d8702b2fcb Initial work on parsing the journal page 2020-06-16 18:52:29 +05:30
Nemo 487b222d79 Adds support for --dont-strip-first-page 2020-05-14 01:04:15 +05:30
Nemo c3722430e1 Adds a check for rate-limit 2020-04-22 18:31:37 +05:30
Nemo ebf1b57e22
Merge pull request #12 from pradn/better-errors
Improve error handling
2020-04-20 03:23:24 +05:30
Prad Nelluru 2206c41228 Use response.body, not response.body_io, which is nil when you pass in HTTPClient for some reason. 2020-04-19 17:50:06 -04:00
Prad Nelluru 4e435dd3ab Add 60s timeout to downloads. Do backoff for all errors. 2020-04-19 17:44:21 -04:00
Prad Nelluru 9659c0ef5e
Trim chapter titles to ensure bookmarks are valid in PDF (#11) 2020-04-20 02:03:30 +05:30
Prad Nelluru 762164e223 more descriptive error messages 2020-04-19 15:18:05 -04:00
Prad Nelluru 77201bda85 Fix download issue - revert to using body_io 2020-04-19 15:00:59 -04:00
Prad Nelluru 483f838d24 Report pdftk and download errors. Add exponential backoff to downloading after download failures. Add top-level rescue block to improve forward progress. 2020-04-19 01:58:20 -04:00
Nemo 1d95cce3f8 Catch another PDF error 2020-04-05 02:14:50 +05:30
Nemo 82ce97cbc8 Adds fix for corrupt PDF error from MUSE 2020-04-04 01:24:35 +05:30
Nemo 00c80bf8e4 Fixes #6 2020-04-04 01:17:31 +05:30
Nemo f3c757984a Skip books that don't support PDF 2020-04-01 01:36:53 +05:30
Nemo 2a78be1022 Adds support for .formats and fixes tests 2020-04-01 01:33:54 +05:30
Nemo 955aec3a1b Adds support for cookies 2020-03-30 02:33:55 +05:30
Nemo d981000d14 Adds stitching and first page strip 2020-03-29 17:51:01 +05:30
Nemo 376adf28cb Fixes some redirect bullshit 2020-03-29 03:52:57 +05:30
Nemo d7043e233a Add URL to options 2020-03-29 02:44:48 +05:30
Nemo 2c07c5940d Don't run main for tests 2020-03-29 02:37:14 +05:30
Nemo e7754344d8 Adds Book parser 2020-03-29 01:21:36 +05:30
Nemo 9447c8e30a Initial commit 2020-03-29 00:59:47 +05:30