Azure
/
AzureKusto
зеркало из https://github.com/Azure/AzureKusto.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
208 коммитов 6 Ветки 5 Теги 490 KiB
Граф коммитов

126 Коммитов

Автор SHA1 Сообщение Дата
Hong Ooi 025f88b656 Dbi (#30) 
* stubs

* dbiConnect works

* add host as server synonym for DBI

* add dbname as database synonym for DBI

* dbCreateTable, dbRemoveTable

* adding methods

* documenting

* force run_query to always return a df

* basic testing

* add tablename validate check

* also validate tablename for dbListFields

* don't always return df from run_query

* support DBI bigint arg

* add dbDisconnect

* polish docs
 2019-02-12 10:02:20 -08:00
hong-revo f51c38e77d fix to use AzureAuth tokens 2019-02-11 22:48:43 +11:00
hong-revo e253ce1622 add pkgname:: to resgrp methods 2019-02-07 21:58:11 +11:00
hong-revo 0b110efe6b use AzureAuth, verify ingestion tests manually 2019-02-07 20:30:02 +11:00
Hong Ooi dc2554f494 Ingest (#26) 
* ingestion endpoint start

* combine query and ingest endpoints

* implementing

* adls2

* rm stray return

* fold run_query, run_command into 1

* add docs

* satisfy check()

* rename back to run_query

* ingestion working

* add adls2 abfss check

* rm stray ...

* fleshing out local ingest

* streaming ingest

* document

* fixup

* shorten function names

* all ingest methods

* hide import from check

* make sure AzureStor is present before loading it

* partial matching wart

* throw error if given blob token

* add ingest_adls1

* fixing streaming ingest

* rm refs to ingestion uri

* local ingest working

* ingestion tests seem ok

* rm print

* update readme

* don't hide ingest result

* fix collect()

* write.csv -> write.table

* escaping strings

* fix ingest_inline
 2019-02-06 08:37:08 -08:00
Alex Kyllo ce8979cd94 Parameterized queries (#22) 
* add query parameter handling

* make query params work with tbl_kusto

* various fixups
 2019-01-31 04:58:48 +11:00
Alex Kyllo 7c9f02df9d get testthat tests to pass with devtools::check() (#21) 
* export methods to get testthat tests to pass when run by devtools::check()

* fix undocumented params in op_base and tbl_kusto

* reexport dplyr functions to fix R CMD CHECK warnings, make function signatures match generics

* don't need importFrom since we already import dplyr
 2019-01-29 14:03:34 +11:00
hong-revo ce7b99feeb add asc as global var 2019-01-24 18:08:29 +08:00
hong-revo 3337049a56 fixes for devtools::check 2019-01-24 17:02:15 +08:00
Alex Kyllo be2a518b31 Add documentation for dplyr API (#17) 
* adding documentation for dplyr API

* add documentation to exported functions in dplyr API to help clean up R CMD CHECK
 2019-01-24 09:11:59 +08:00
Alex Kyllo 9769f265b8 fix roxygen formatting for tbl_kusto 2019-01-23 12:05:54 -08:00
Alex Kyllo d5774348d1 @export on tbl_kusto got commented out, fixing that 2019-01-23 12:04:44 -08:00
Hong Ooi 131c3a4509 Query props (#14) 
* init query option passing

* better

* whoops

* adding documentation

* doc fixups

* integer64 flag

* rm rappdirs

* make bit64 optional

* docs

* don't attach dplyr in testing

* update README example for integer64 change

* don't support dynamic json for now

* rm comment block

* add .env and test-creds to gitignore

* remove other integer64 example from readme
 2019-01-23 08:51:33 -08:00
hong-revo 221919b97f fixes for endpoint processing 2019-01-17 05:38:57 +11:00
Hong Ooi 3632a0fbf7
database endpoint revision (#9) 
Major changes:
* Allow get_kusto_token to use own app
* Warn that federated login is unsupported
* Integration tests
* Refactoring
 2019-01-16 23:04:19 +11:00
Alex Kyllo 8e2ed2ee45 Allow cluster URIs without location specification. Make n() translate to count() instead of count. Add basic usage examples to README. 2019-01-14 10:40:53 -08:00
Alex Kyllo 578dc9217e Implement dplyr API (#6) 
* import rlang

* refactoring

* refactored and tests passing again

* add tests for kql-escape

* added arrange function

* remove purrr dependency

* merge namespace file

* start working on group_by, summarize, and ungroup

* finalize changes to replace AzureDataExplorer with AzureKusto name

* implemented group_by and summarise

* make mutate() work with agg functions

* add rename() verb

* add head() verb

* start implementing join

* add tbl_kusto class

* implement collect() verb

* make render() quote the database name for show_query and collect

* get basic one-column inner join working

* add basic support for one-column left, right, outer, anti, semi joins

* handle join on one differently-named column

* make join work with multiple differently named columns

* add verb: union_all as this is the only setop flavor supported by Kusto

* error on unsupported setops

* remove DBI stuff for now

* remove DBI as an import

* remove DBITest from suggested imports

* add rlang to imports list in DESCRIPTION

* various cleanup

* rename tbl_abstract to tbl_kusto_abstract

* remove call to as.tibble in collect()

* add tibble to Imports and call  as.tibble in collect() method

* add tibble to Imports and call  as.tibble in collect() method

* remove tibble from DESCRIPTION and call dplyr::as_tibble instead
 2019-01-15 03:50:15 +11:00
hong-revo 43db429902 ade/data_explorer->kusto 2019-01-09 17:57:11 +11:00
hong-revo d71041c802 initial name change 2019-01-09 17:33:34 +11:00
Hong Ooi 60a25d6603
Refactoring query endpoint interface (#4) 
* add basicauth support to query

* cleanup output of add/remove/list_principals

* refactor query endpoint

* don't output factors

* basic validity checking on endpoint properties

* allow use of usertoken, apptoken to run queries
 2019-01-09 16:49:52 +11:00
hong-revo 9c73842d6f temp fix for document error 2019-01-06 20:57:19 +11:00
hong-revo 27b83b42e1 rm unvectorised add/rm principal 2019-01-04 15:51:41 +11:00
Alex Kyllo 6e69e04e5e start implementing mutate verb 2019-01-02 20:43:08 -08:00
Alex Kyllo 1be42d9277 code formatting clean-up 2019-01-02 15:29:51 -08:00
Alex Kyllo 6fb52614b9 handle multiple filter expressions as separate where clauses 2019-01-02 15:22:09 -08:00
Alex Kyllo 7bcf9c49d7 work on metaprogramming to support filter() 2019-01-02 14:58:28 -08:00
Alex Kyllo 0d177db0dc make distinct work for multiple columns 2019-01-02 08:59:36 -08:00
Alex Kyllo 9bdbb7fe12 make select and distinct work for multiple columns 2019-01-02 08:56:25 -08:00
Alex Kyllo 9d240210c7 correction: select is project in KQL 2019-01-01 23:12:20 -08:00
Alex Kyllo b8cdaa1290 set up basic data structures for translating dplyr select and distinct into KQL 2019-01-01 23:10:17 -08:00
Alex Kyllo e0b04c3def separate tbl data and ops into different list elements 2019-01-01 19:17:00 -08:00
Alex Kyllo e0449f8ae2 clean up tbl.R, add method for creating a dummy tbl from a tibble 2019-01-01 18:59:39 -08:00
Alex Kyllo 39c7cc0adc sync up 2018-12-31 08:03:07 -08:00
Alex Kyllo 38d5429557 . 2018-12-31 08:03:07 -08:00
hong-revo 9288a6f4e8 tweaking ade_database_endpoint 2018-12-28 18:35:14 +11:00
hong-revo b2ce9cab09 add database_endpoint.character using cluster name 2018-12-26 16:23:07 +11:00
hong-revo 7dcdd637b9 readd explicit aad_host arg 2018-12-26 13:39:27 +11:00
hong-revo 10c8b385fc use argnames for get_azure_token call 2018-12-26 13:34:24 +11:00
hong-revo f931cedf7a globalVariables check 2018-12-24 22:22:55 +11:00
hong-revo 3f95dfc7e0 allow etag field 2018-12-24 11:50:06 +11:00
hong-revo f4cf7076e9 tidy list_databases result 2018-12-24 04:11:38 +11:00
hong-revo 1f8cbe84d9 add vectorised add/remove principals 2018-12-24 03:26:27 +11:00
hong-revo 71d8f0ea98 make run_query/cmd generics 2018-12-24 02:38:52 +11:00
hong-revo d1c89408a2 put delete msg in right place 2018-12-23 11:20:23 +11:00
hong-revo d922ea32cf query works 2018-12-22 17:16:51 +11:00
hong-revo 0e9171e3f7 clearer object names 2018-12-22 16:07:59 +11:00
hong-revo e19fa4c51d get_ade_database 2018-12-22 15:48:26 +11:00
hong-revo f754d8418b database ARM class 2018-12-22 15:42:07 +11:00
hong-revo 407c25f274 rm stray arg 2018-12-22 04:49:26 +11:00
hong-revo aa073bb41a fix add/remove principal 2018-12-22 04:18:02 +11:00
hong-revo 8876e46fd7 add/remove principal 2018-12-22 04:02:59 +11:00
hong-revo 2425da7f5a list principals 2018-12-22 03:08:52 +11:00
hong-revo ec1b28b4a7 password workaround in dev AzureRMR 2018-12-21 16:43:33 +11:00
hong-revo ac2106f1e7 depend on dev AzureRMR 2018-12-21 11:31:41 +11:00
hong-revo f2d7cb75d1 basic ARM methods 2018-12-21 00:56:53 +11:00
hong-revo 23e2863729 rename ade_cluster 2018-12-20 10:45:56 +11:00
hong-revo 2a506335d0 fixup exports 2018-12-19 21:51:13 +11:00
hong-revo 2d57f2e0fc fixup run_query, run_command 2018-12-19 21:37:49 +11:00
hong-revo 1404f3f78f document 2018-12-19 21:21:40 +11:00
hong-revo bcfd15855c cluster, database classes 2018-12-19 21:20:38 +11:00
hong-revo cabb8f927c fleshing out framework 2018-12-19 20:41:18 +11:00
hong-revo 0a686327db fix convert_kusto_datatype 2018-12-19 15:10:01 +11:00
hong-revo 5c7a796bcc get run_command working 2018-12-19 14:56:00 +11:00
hong-revo 35aead970c tweaking 2018-12-18 17:04:37 +11:00
hong-revo 2b0c8d8f0f exporting 2018-12-18 16:47:01 +11:00
hong-revo b76501f56a separate run query and command functions 2018-12-18 16:37:41 +11:00
hong-revo 48ce6a569a result parsing 2018-12-18 16:21:17 +11:00
hong-revo 6d0926264f error message 2018-12-17 17:29:54 +11:00
hong-revo d7e41c47da query 2018-12-17 00:34:15 +11:00
hong-revo 97c9ffd062 document() 2018-12-16 19:41:46 +11:00
hong-revo 3ab48abd80 endpoint WIP 2018-12-15 22:09:13 +11:00
hong-revo e5709f7b6c delete working 2018-12-11 21:51:19 +11:00
hong-revo 6b654036d5 ARM api works 2018-12-11 21:23:06 +11:00
hong-revo 040be56897 tweaking 2018-12-11 14:16:21 +11:00
hong-revo c31c89b826 stub class 2018-12-11 14:07:16 +11:00
hong-revo b93e5e29aa initial commit 2018-12-11 14:05:23 +11:00