9027e29afe
ci/azure-build-and-test.yml: fix the coverage job when wwt_data_formats on conda-forge is too old
2021-02-08 22:13:25 -05:00
fa12246c02
Silence some warnings from Numpy 1.20.
2021-02-08 22:02:28 -05:00
f5389e0052
Properly handle CLI glob arguments on Windows
...
Following from `wwt_data_formats`. It turns out that we need to manually
implement them for Windows cmd.
2021-02-08 21:21:35 -05:00
b1e8b544b3
Merge pull request #45 from pkgw/bugs
...
A couple of more pipeline fixes
2021-02-03 10:07:52 -05:00
a2df3c1d4f
toasty/image.py: try to standardize unexpected PIL modes
...
This should Do The Right Thing if the image is in L or P mode. I'm
getting weird results with a sample image that's showing up as "RGBX"
mode, but we'll start with this.
2021-02-02 18:55:29 -05:00
6f451f56a3
toasty/pipeline/djangoplicity.py: work around a metadata corner case
...
As observed in noao-02274.
2021-02-02 18:40:13 -05:00
8470a3e777
toasty/pipeline/djangoplicity.py: make sure to use UTF8 encoding
2021-02-02 18:21:59 -05:00
c3e9524662
Merge pull request #44 from pkgw/bugs
...
toasty/pyramid.py: fix selection of default image format
2021-02-02 18:13:34 -05:00
4879b918f8
toasty/pyramid.py: fix selection of default image format
...
If the target directory didn't exist, we were leaving the format as
None.
Closes #43 .
2021-02-02 18:04:53 -05:00
8285baf4ac
Merge pull request #42 from pkgw/eso-pipeline
...
pipeline: get Djangoplicity working for eso.org
2020-12-17 11:03:17 -05:00
d3d0c3cc41
pipeline: require and report not-actionable reasons
2020-12-17 10:47:25 -05:00
d7ff3237c0
pipeline: hack to tidy up process-todos output
2020-12-17 10:47:09 -05:00
916763b733
pipeline: get Djangoplicity working for eso.org
...
It turns out that the eso.org installation of Djangoplicity has some
differences from the NOIRLab one that mean that we have to add a few
more bells and whistles:
- Make TLS-no-verify optional (not strictly required, but good to do)
- The search pagination URLs are different
- Handle gzipped content from the server
We centralize the request-making code a bit to make it easier to support
all of these consistently.
2020-12-17 10:45:08 -05:00
f083551de0
Merge pull request #41 from pkgw/pipeline-fixes
...
Some pipeline fixes for @astrodavid10
2020-12-08 22:18:28 -05:00
483b1021a7
docs/cli/pipeline-fetch.rst: mention that some images are rejected
2020-12-08 22:08:26 -05:00
09e5beb874
toasty/tests/test_pipeline.py: try to get some coverage in the glob tests
2020-12-08 22:05:51 -05:00
495077daff
docs/api: update
2020-12-08 21:50:43 -05:00
9e806367e9
pipeline: add support for globby arguments in fetch and approve
2020-12-08 21:50:35 -05:00
6390e55d7d
pipeline fetch: try to avoid crashing on NotActionable on Windows
...
We were trying to move the "candidate" directory with a file open inside it,
which isn't allowed on Windows.
2020-12-08 21:19:18 -05:00
c85c4ddb7b
We currently require a much newer version of wwt_data_formats
2020-12-08 21:09:23 -05:00
d1b0af796e
docs: some minor improvements
2020-12-08 21:08:22 -05:00
cd1bf576a2
Merge pull request #40 from pkgw/pipelines
...
Get pipelines ready to go
2020-12-03 21:50:14 -05:00
ad92b39452
docs/pipeline.rst: use different Djangoplicity example since NOIRLab's SSL is busted
2020-12-03 21:39:56 -05:00
fb27bf6ffe
toasty/pipeline/__init__.py: make sure to default to PNG format
2020-12-03 21:38:32 -05:00
81e72d3a18
Fix RGB cascades
...
We need to use `update_into_maskable_buffer`, not
`fill_into_maskable_buffer`, because the latter resets the entire buffer
for each of the four sub-tiles. And Numpy has apparently become more
strict about the shape of arrays used with putmask.
2020-12-03 21:38:15 -05:00
544e469ced
toasty/pyramid.py: fix search pattern for LXY naming scheme
2020-12-03 21:34:58 -05:00
b6393862ee
pipeline: get the test working again
...
Much easier than anticipated!
2020-12-03 20:59:52 -05:00
24a6c1469a
docs: write up for-realsies pipeline documentation
2020-12-03 20:59:52 -05:00
fbff5b979f
pipeline: remove "reindex" command (... for now?)
2020-12-03 20:59:52 -05:00
496c8d9f05
pipeline: add/adapt "publish" command now that "approve" is a thing
2020-12-03 20:59:52 -05:00
5513bcdccd
pipeline: add "approve" step, in which we generate index.wtml
2020-12-03 20:59:52 -05:00
0e60c84a9a
pipeline: update djangoplicity to generate awesome metadata
...
... as defined by the new `wwtdatatool wtml report` utility.
2020-12-03 20:59:52 -05:00
abbb77f9aa
pipeline: make the loaders framework extensible
...
As it was before. I needed to do this for the APOD demo.
2020-12-03 20:59:52 -05:00
f166388ffb
toasty/pipeline/djangoplicity.py: fix WCS processing
2020-12-03 20:59:52 -05:00
2b79a0c616
pipeline: checkpoint Djangoplicity work
2020-12-03 20:59:52 -05:00
4a742caec0
pipeline: start working on Djangoplicity support
2020-12-03 20:59:52 -05:00
97c4cbbd3c
pipeline: update image processing to use the Builder
2020-12-03 20:59:46 -05:00
b37c340d72
pipeline: CandidateInput.cache_data no longer needed
2020-12-03 20:58:48 -05:00
9d9c78ffee
pipeline: turn "fetch-inputs" into the "fetch" command
2020-12-03 20:58:48 -05:00
ff2ea729bc
pipeline: add a "refresh" command
...
This will allow processing of only a subset of the available images.
2020-12-03 20:58:48 -05:00
765cf03788
pipeline: move AstroPix impl to a separate module
2020-12-03 20:58:48 -05:00
8b4caa28ad
pipeline: start working on polished CLI approach
...
It turns out that the Azure Storage Python API has evolved significantly. Annoying.
2020-12-03 20:58:48 -05:00
bce75b7ee6
pipeline: move pipeline CLI wire-ups into a "cli" module here
2020-12-03 20:58:48 -05:00
8594156ea1
pipeline: move local filesystem I/O into its own file
2020-12-03 20:58:48 -05:00
b7e560e097
pipeline: move Azure I/O into its own file
2020-12-03 20:58:48 -05:00
d4c6ebad84
Turn toasty.pipeline into a package, not just a module
2020-12-03 20:58:48 -05:00
b3b4c58123
Merge pull request #30 from astrofrog/initial-fits-support
...
Add support for tiling FITS studies
2020-11-24 08:26:15 -05:00
7e8cd90d8d
Fixed docstrings
2020-11-24 13:18:13 +00:00
a0f18631b1
Updated docs
2020-11-23 14:01:28 +00:00
98487ca289
Fix docs warnings
2020-11-23 13:54:55 +00:00
Peter Williams
Thomas Robitaille