Граф коммитов

197 Коммитов

Автор SHA1 Сообщение Дата
matheswaran 2648d08f58 Copying the source code of Data Integration platform Registry V -0.1 in the github location. 2019-04-23 15:04:31 +05:30
Bryan Bende ceca1e9232
NIFIREG-244 Updated Admin Guide documentation
- Added section describing Access Policies to Admin Guide
- Added sections to Admin Guide on extension bundle persistence providers
- Added Identity Mapping Properties section to Admin Guide
- Added Admin Guide section on URL aliasing

This closes #171.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-04-22 17:13:06 -04:00
Kevin Doran 49ffd812d7
NIFIREG-216 - S3BundlePersistenceProvider
- Add optional S3 Endpoint URL override property
- Add Bundle Persistence Docker configuration via environment

This closes #169.
2019-04-22 17:05:59 -04:00
Bryan Bende 82a7e7a5c3
NIFIREG-216 - S3BundlePersistenceProvider
- Setup AWS extensions and add S3BundlePersistenceProvider
- Refactor BundlePersistenceProvider API and updated implementations accordingly
- Include AWS extensions by default
2019-04-22 17:05:44 -04:00
Bryan Bende a066996667 NIFIREG-250 Fixing logback to correctly use bootstrap property for location of nifi-registry-app.log 2019-04-19 11:03:48 -04:00
Bryan Rosander 36b42d6d39
NIFIREG-238: Allow aliasing of registry url
NIFIREG-238: PR Feedback
PR Feedback - Unique constraint on internal token
PR Feedback - Using map to store aliases
Updating default properties file

This closes #162.

Signed-off-by: Bryan Bende <bbende@apache.org>
2019-04-12 15:21:44 -04:00
Bryan Bende c2e40559e6
NIFIREG-249 - Allow creating a flow snapshot as the latest version by sending a version of -1
This closes #168.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-04-10 14:49:08 -04:00
Bryan Bende 81ee541db3
NIFIREG-248 Fixing usage of the JAX-RS Link class so that it works correctly with swagger code-gen
- Changing JaxbLink params map to be strings to better align with swagger code-gen, and fixing overloaded method names

This closes #167.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-04-02 13:31:44 -04:00
Bryan Bende 2bc5fa7bb7
NIFIREG-245 Refactoring REST API docs to generate asciidoc from swagger spec and convert to html
- Removing values from @ApiModel so all models use default name from Java class
- Standardizing all @ApiOperation annotations to have a short value + notes, fixing problem with two models named Bundle

This closes #164.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-04-02 10:19:14 -04:00
Bryan Bende d026611b8d
NIFIREG-233 Setup ExtensionDocWriter with HTML implementation and REST resource to retrieve docs
- Added end-point to retrieve additional details content
- Added links to docs from extension metadata and extension repo
- Added client methods to retrieve docs

This closes #163.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-04-02 10:14:08 -04:00
Bryan Bende 351849055e
NIFIREG-247 Adding ScheduleState enum and adding field to processor, port, and remote port
This closes #165.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-04-02 09:36:58 -04:00
Bryan Rosander 563bfeda97
NIFIREG-234: Publish events for tenant CRUD
This closes #161.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-03-13 16:34:05 -04:00
Bryan Bende e851401bde
NIFIREG-213 Implementing parser for extension-docs.xml file and integrating into the NarBundleExtractor
- Incorporating BuildInfo into DB and appropriate entity/model classes
- Added ProvidedServiceAPI to DB schema, entities, and metadata service
- Added Restrictions to DB, entity classes, and metadata service
- Refactored DataModelMapper into separate classes
- Updated StandardExtensionService to persist Extensions to DB
- Added link to extension-metadata from extension repo API
- Updated NarBundleExtractor to extract additionalDetails and added additionalDetails to DB schema and entities
- Added REST end-points to access extension metadata by bundle version
- Refactored NarBundleExtractor to unmarshall extension-manifest.xml using Jackson XML
- Refactored how extensions are stored in the DB to store a serialized version of the content
- Removed extension prefix from bundle and bundle version class and tables
- Added ExtensionResource to get all extensions
- Creating links from ExtensionMetadata to Extension
- Added swagger and validation annotations to extension model objects
- Added filter params for retrieving extensions
- Added ExtensionClient and JerseyExtensionClient
- Added REST end-point to search by provided service API
- Added display name to extensions
- Added versioned serializer for the Extension entity
- Added comment to default providers.xml about ordering of providers

This closes #160.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-03-13 15:34:27 -04:00
Bryan Rosander cf0e35b80f NIFIREG-232 Introducing flow persistence provider migrator and toolkit (#159)
* NIFIREG-232 Introducing flow persistence provider migrator and toolkit

* PR feedback
2019-03-12 10:36:47 -04:00
Jason Rogena 161d719bd7
NIFIREG-230 Fix Typo In dockerhub README
The README.md file in the dockerhub directory suggests that the NiFi
Registry image is tagged as 'apache/nifi:latest' instead of
'apache/nifi-registry:latest'. This seems to be a typo.

This closes #158.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2019-02-26 10:37:36 -08:00
Kevin Doran 6a64ba3857
NIFIREG-229
- Catch thrown errors and exceptions in background ldap sync task to prevent killing the thread
- Improve logging by moving some warns to debug for potentially valid configurations and add more debug output.

This closes #157
2019-02-25 13:29:00 -05:00
Kevin Doran d4410de8c0 NIFIREG-225: Fix NPE in getAccessPolicesForUser (#156) 2019-02-22 12:37:59 -05:00
Justin Gondron 1dcf960606
NIFIREG-226: Bugfix overriding flow provider in Docker container via environment variables
The script which maps env to flow provider properties is currently not overwriting the file, but instead sending to stdout.
This should fix the issue in the Docker update_flow_provider script.

Note: This replicates a fix also made in pull requests #132 and #150 on github.

This closes #152.
This closes #150.
This closes #132.

Co-authored-by: Joao C Costa <joaocc@users.noreply.github.com>
Co-authored-by: silver2k <colin@findlay.geek.nz>
Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-02-14 12:23:58 -05:00
Justin Gondron cdb39d398f
NIFIREG-226: Fix overriding db props in Docker via environment variables
The mapping from env to registry properties for the database user, pass, and max connections are referencing the incorrect property names.
This should fix the issue in the Docker update_database.sh script, and correct other references in the documentation.

This closes #151.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-02-14 10:29:51 -05:00
Bryan Bende ecce44e587
NIFIREG-217 Adding identity and group transforms
This closses #154.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-02-12 13:42:32 -05:00
Bryan Bende 5fb657ebca
NIFIREG-209 Rebuild metadata DB from FlowPersistenceProvider when empty DB AND when instance of MetadataAwareFlowPersistenceProvider
This closes #144.
2019-01-28 14:15:28 -05:00
Kevin Doran 5895b201f0
NIFIREG-220 New test certs
Replacing the test TLS certs in the source code repository
with new certs that were signed by a tracked CA key. Also
adding instructions for generating additional keys in the
future if needed.
Corrections to README based on peer-review feedback
Updated shell script in README to create uniq working dir

This closes #153.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-12-18 14:39:30 -08:00
Bryan Bende ce405b5762
NIFIREG-215 - Extension Bundle Improvements
- Adding content size field extension bundle version
- Adding optional filters to the get all bundles end-point
- Bumping minor versions of spring boot and spring security
- Adding /bundles/versions with filter params
- Added new client method to return an optional checksum for a given group, artifact, and version
- Adding support for SNAPSHOT versions
- Adding flag on buckets to indicate if redeploying extension bundle versions is allowed

This closes #149.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-12-13 13:33:59 -05:00
Bryan Bende f1e5aef7be
NIFIREG-211 Initial work for adding extenion bundles to NiFi Registry
- Setting up DB tables and entities for extensions
- Updated MetadataService and DatabaseMetadataService with new methods for extension entities
- Added ON DELETE CASCADE to existing tables and simplified delete logic for buckets and flows
- Created data model for extension bundles and mapping to/from DB entities
- Created ExtensionBundleExtractor with an implemenetation for NARs
- Setup LinkService and LinkBuilder for extension bundles
- Setup pluggable persistence provider for extension bundles and implemented a local file-system provider.
- Refactored LinkService and add links for all extension related items
- Changed extension service to write out bundles to a temp directory before extracting and passing to persistence provider
- Implemented multi-part form upload for extensions bundles
- Upgraded to spring-boot 2.1.0
- Added SHA-256 checksums for bundle versions
- Initial client methods for uploading and retrieving bundles
- Configuring NiFi Registry Jersey client to use chunked entity processing so we don't load the entire bundle content into memory during an upload
- Added event publishing for extension bundles
- Add an adapter for serializing ExtensionBundleType enum
- Remove capitalize class from droplet grid item
- Add ability for clients to optionally specify the SHA-256 when uploading a bundle

This closes #148.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-11-30 13:56:18 -05:00
Koji Kawamura 312a179b67
NIFIREG-205: Allow Git repo to delete a flow with snapshot version 0
This closes #146.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-06 14:47:17 -05:00
Andrew Lim e74846402b NIFIREG-210 Corrected incorrect document-links
This closes #145

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-11-02 11:21:30 -04:00
Bryan Bende 010695fa1a
Updating travis.yml with output filters
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-01 10:51:25 -04:00
Bryan Bende 78e6b0e8e5
Adding travis-output-filters 2018-11-01 10:23:59 -04:00
Kevin Doran e3d67d9314
Merge branch 'NIFIREG-202-rc1' 2018-09-25 11:35:25 -04:00
Kevin Doran d05d0e9bc1
NIFIREG-202-RC1 prepare for next development iteration 2018-09-22 09:02:17 -04:00
Kevin Doran 2fef9fac2b
NIFIREG-202-RC1 prepare release nifi-registry-0.3.0-RC1 2018-09-22 09:02:06 -04:00
Kevin Doran 66d0078bc8
Empty commit to fix github mirror 2018-09-21 22:15:17 -04:00
Bryan Bende 6f26290d78
NIFIREG-201 Refactoring project structure to better isolate extensions
This closes #143.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-09-21 22:10:04 -04:00
Kevin Doran 9258ad55e8
NIFIREG-200 Update dependencies
- Update Jetty to version 9.4.11.v20180605
- Update Spring Boot to version 2.0.4.RELEASE
- Update Spring Security to version 5.0.7.RELEASE
- Update Jackson to version 2.9.6
- Remove Guava dependency (unused) from nifi-registry-web-api

This closes #142.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-09-21 12:13:19 -04:00
Matt Gilman 6a91000860
NIFIREG-186 Referencing the correct parent artifact.
This closes #141.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-09-20 15:31:57 -04:00
Koji Kawamura e1bd6e26f3
NIFIREG-186: Adding Ranger authorizer
- Ranger Authorizer is deployed as Registry extension.
- Added /config REST endpoint to expose Registry configuration for UI to
determine if user, group and policies can be edited.
- Added 'include-ranger' maven build profile and refactored project
structure to control ranger extension build.
- Added README.md to illustrate how to use this extension.
- Added default configuration files.
- Remove javax.ws.rs package in jersey-bundle jar to avoid rs version conflict.
- Added example conf to audit to Kerberized Solr.
- Updated hadoop version to 3.0.0
- Added ExtensionCloseable to use extension class loader when
  configuring authorizer. Without this, Hadoop Configuration class uses
  WebApp class loader that is set to current thread context class loader
  which does not have extension classes.
- Refactored anonymous inner classes at AuthorizerFactory to expose
  underlying authorizer instance, to use its extension class loader.
- Confirmed NiFi Registry can:
  - download policies from Kerbelized Ranger
  - send audit logs to Kerbelized Solr
  - send audit logs to Kerbelized HDFS
- Refactored project structures and updated L&N.

This closes #131.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-09-20 13:51:55 -04:00
Bryan Bende 8b54876ec8
NIFIREG-199 - Adding interfaces to represent configurable components and extension components
This closes #140.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-09-18 11:21:09 -04:00
Kevin Doran 1cff92488a
NIFIREG-198 Add unit test that reproduces bug
NIFIREG-198 Fix VersionedRemoteProcesGroup targetUri

NIFIREG-198 Deprecate VersionedRemoteProcessGroup targetUri

This closes #139.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-09-18 09:35:02 -04:00
Jeremy Dyer 3672f8b986
NIFIREG-192: Implement REGISTRY_START event
This closes #134.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-08-21 10:28:03 -04:00
Kevin Doran ead0ea6e66
[NIFIREG-193] Empty commit to close #135. 2018-08-20 13:14:50 -04:00
Jeremy Dyer d48c9b8cfb
NIFIREG-190 Add support for whitelist filtering Event Hook providers
This closes #133.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-08-20 12:55:05 -04:00
Scott Aslan b2e8ef3406 [NIFIREG-196] update client deps
Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>

This closes# 138
2018-08-19 15:15:15 -04:00
Bryan Bende b11eb533fc
NIFIREG-194 Fixing incorrect variable assignment in VersionedConnection 2018-08-16 12:03:23 -04:00
Scott Aslan d8188e07e0
[NIFIREG-193] upgrade superagent 2018-08-16 10:18:41 -04:00
Andrew Lim d4a3d5efd0 NIFIREG-191 Make formatting consistent in Registry docs and minor fixes
This closes #137

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-08-15 14:26:18 -04:00
Mark Payne cb3b292faf
NIFIREG-194: Updated VersionedConnection to support load balancing configuration
NIFIREG-194: Added allowableValues to annotation for the getLoadBalanceCompression() method of VersionedConnection

This closes #136.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-08-14 13:47:00 -04:00
Andrew Lim 7e4e971340 NIFIREG-185 Added elment id's to facilitate User testing use cases
This closes #130

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-07-13 09:15:30 -04:00
Mike 45361876b3
NIFIREG-181 Updated registry docker build to make flow provider configurable.
This closes #129.

Signed-off-by: Aldrin Piri <aldrinpiri@gmail.com>
2018-07-09 12:53:02 -04:00
Mike 59348b5aa7
NIFIREG-180 Added db configuration properties to the docker image.
This closes #128.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-06-29 12:39:05 -04:00
Aldrin Piri 6abbfe1c63
NIFIREG-178 Updating Docker versions for next development version.
This closes #127.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-06-25 14:18:54 -04:00