f083551de0
Merge pull request #41 from pkgw/pipeline-fixes
...
Some pipeline fixes for @astrodavid10
2020-12-08 22:18:28 -05:00
483b1021a7
docs/cli/pipeline-fetch.rst: mention that some images are rejected
2020-12-08 22:08:26 -05:00
09e5beb874
toasty/tests/test_pipeline.py: try to get some coverage in the glob tests
2020-12-08 22:05:51 -05:00
495077daff
docs/api: update
2020-12-08 21:50:43 -05:00
9e806367e9
pipeline: add support for globby arguments in fetch and approve
2020-12-08 21:50:35 -05:00
6390e55d7d
pipeline fetch: try to avoid crashing on NotActionable on Windows
...
We were trying to move the "candidate" directory with a file open inside it,
which isn't allowed on Windows.
2020-12-08 21:19:18 -05:00
c85c4ddb7b
We currently require a much newer version of wwt_data_formats
2020-12-08 21:09:23 -05:00
d1b0af796e
docs: some minor improvements
2020-12-08 21:08:22 -05:00
cd1bf576a2
Merge pull request #40 from pkgw/pipelines
...
Get pipelines ready to go
2020-12-03 21:50:14 -05:00
ad92b39452
docs/pipeline.rst: use different Djangoplicity example since NOIRLab's SSL is busted
2020-12-03 21:39:56 -05:00
fb27bf6ffe
toasty/pipeline/__init__.py: make sure to default to PNG format
2020-12-03 21:38:32 -05:00
81e72d3a18
Fix RGB cascades
...
We need to use `update_into_maskable_buffer`, not
`fill_into_maskable_buffer`, because the latter resets the entire buffer
for each of the four sub-tiles. And Numpy has apparently become more
strict about the shape of arrays used with putmask.
2020-12-03 21:38:15 -05:00
544e469ced
toasty/pyramid.py: fix search pattern for LXY naming scheme
2020-12-03 21:34:58 -05:00
b6393862ee
pipeline: get the test working again
...
Much easier than anticipated!
2020-12-03 20:59:52 -05:00
24a6c1469a
docs: write up for-realsies pipeline documentation
2020-12-03 20:59:52 -05:00
fbff5b979f
pipeline: remove "reindex" command (... for now?)
2020-12-03 20:59:52 -05:00
496c8d9f05
pipeline: add/adapt "publish" command now that "approve" is a thing
2020-12-03 20:59:52 -05:00
5513bcdccd
pipeline: add "approve" step, in which we generate index.wtml
2020-12-03 20:59:52 -05:00
0e60c84a9a
pipeline: update djangoplicity to generate awesome metadata
...
... as defined by the new `wwtdatatool wtml report` utility.
2020-12-03 20:59:52 -05:00
abbb77f9aa
pipeline: make the loaders framework extensible
...
As it was before. I needed to do this for the APOD demo.
2020-12-03 20:59:52 -05:00
f166388ffb
toasty/pipeline/djangoplicity.py: fix WCS processing
2020-12-03 20:59:52 -05:00
2b79a0c616
pipeline: checkpoint Djangoplicity work
2020-12-03 20:59:52 -05:00
4a742caec0
pipeline: start working on Djangoplicity support
2020-12-03 20:59:52 -05:00
97c4cbbd3c
pipeline: update image processing to use the Builder
2020-12-03 20:59:46 -05:00
b37c340d72
pipeline: CandidateInput.cache_data no longer needed
2020-12-03 20:58:48 -05:00
9d9c78ffee
pipeline: turn "fetch-inputs" into the "fetch" command
2020-12-03 20:58:48 -05:00
ff2ea729bc
pipeline: add a "refresh" command
...
This will allow processing of only a subset of the available images.
2020-12-03 20:58:48 -05:00
765cf03788
pipeline: move AstroPix impl to a separate module
2020-12-03 20:58:48 -05:00
8b4caa28ad
pipeline: start working on polished CLI approach
...
It turns out that the Azure Storage Python API has evolved significantly. Annoying.
2020-12-03 20:58:48 -05:00
bce75b7ee6
pipeline: move pipeline CLI wire-ups into a "cli" module here
2020-12-03 20:58:48 -05:00
8594156ea1
pipeline: move local filesystem I/O into its own file
2020-12-03 20:58:48 -05:00
b7e560e097
pipeline: move Azure I/O into its own file
2020-12-03 20:58:48 -05:00
d4c6ebad84
Turn toasty.pipeline into a package, not just a module
2020-12-03 20:58:48 -05:00
b3b4c58123
Merge pull request #30 from astrofrog/initial-fits-support
...
Add support for tiling FITS studies
2020-11-24 08:26:15 -05:00
7e8cd90d8d
Fixed docstrings
2020-11-24 13:18:13 +00:00
a0f18631b1
Updated docs
2020-11-23 14:01:28 +00:00
98487ca289
Fix docs warnings
2020-11-23 13:54:55 +00:00
b966359302
Fix auto-detection of format in PyramidIO
2020-11-23 13:27:41 +00:00
604d142d8c
More cleanup to remove use of mode where it is not necessary
2020-11-23 09:29:02 +00:00
d62f26897f
Started removing image mode where it isn't needed
2020-11-23 09:29:01 +00:00
79e4785d5e
Try and automatically determine default_format
2020-11-23 09:28:05 +00:00
be1b2ddf14
Added TODO note
2020-11-23 09:28:05 +00:00
4b881d443b
Fixed make_maskable_buffer to work with 64-bit floating point mode
2020-11-23 09:28:05 +00:00
27e5f524ba
Fix docs build
2020-11-23 09:28:05 +00:00
5f6021eeb2
More minor fixes
2020-11-23 09:28:05 +00:00
15ef022420
Ensure tile-study sub-command uses WCS information if available
2020-11-23 09:28:05 +00:00
447696c9de
Add a new WCS property to Image
2020-11-23 09:28:05 +00:00
1520d012b5
More improvements to API
2020-11-23 09:28:05 +00:00
398ac6bcce
Fix test/docs failures
2020-11-23 09:28:05 +00:00
0f41318758
Added a format= option for Image and PyramidIO and added preliminary support for FITS
2020-11-23 09:28:05 +00:00
Peter Williams
Thomas Robitaille