Граф коммитов

242 Коммитов

Автор SHA1 Сообщение Дата
Terry Kim 989a82b1bd
Upgrade sbt-pgp to 2.1.2 (#455) 2021-06-07 08:40:54 -07:00
Terry Kim 0011d0ded9
Update the JAR name from hyperspace-core_spark*.* to hyperspace-core-spark*.* (#451) 2021-06-01 11:21:12 -07:00
Terry Kim 72230221a8
Update the contributor list (#450) 2021-06-01 09:42:13 -07:00
EJ Song 2dedbff622
Clean up previous FilterIndexRule and JoinIndexRule (#448) 2021-05-31 09:22:07 -07:00
EJ Song 3a91624693
Enable ApplyHyperspace rule (#446) 2021-05-28 10:10:39 -07:00
EJ Song 17cd87ff17
Add a notebook for Delta Lake support (#447) 2021-05-26 13:17:57 -07:00
EJ Song ebbf5b3c93
ApplyHyperspace rule - JoinIndexRule (#445) 2021-05-24 18:07:42 -07:00
EJ Song b46d1340fa
ApplyHyperspace rule - FilterIndexRule (#442) 2021-05-21 12:01:36 -07:00
EJ Song 3257d22717
ApplyHyperspace rule - CandidateIndexCollector implementation (#437) 2021-05-18 20:19:38 -07:00
EJ Song a0f3dd3e5c
Add ApplyHyperspace rule definitions (#427) 2021-05-07 17:41:42 -07:00
Chungmin Lee 5aee0c8fb6
Support Spark 3.1.1 (#434) 2021-05-07 13:15:38 -07:00
EJ Song ba4e71273e
Update .gitignore for IntelliJ on Windows (#438) 2021-04-29 08:18:25 -07:00
Terry Kim 55ee94465c
Fix sbt-launch-lib.bash (#436) 2021-04-28 19:47:58 -07:00
Chungmin Lee 8ab4278a88
Update README.md on using IntelliJ (#435) 2021-04-28 08:40:07 -07:00
EJ Song f6631da248
Handle empty version string in DeltaLakeRelation.closestIndex (#433) 2021-04-28 08:21:28 -07:00
Chungmin Lee 4f8f24b9bc
Cross library build for Spark 2/3 (#421) 2021-04-27 23:14:52 -07:00
Terry Kim ad4b3af899
Update CONTRIBUTING.md for PR submission guide for a major feature (#378) 2021-04-22 16:42:03 -07:00
Apoorve Dave a373eef213
Deterministic index selection for filter rule with no hybrid scan (#428) 2021-04-22 12:16:42 -07:00
EJ Song dafbb13b34
Add a state barrier for getLatestStableLog (#398) 2021-04-19 18:26:05 -07:00
Apoorve Dave 6e86a3e248
Remove linefeed check from gold standard plan comparison (#419) 2021-04-19 12:15:50 -07:00
EJ Song b8a44b490d
Azure pipeline fix - sbt 1.4.9 (#416) 2021-04-13 10:50:34 -07:00
Chungmin Lee 9b103c8fb7
Refactor and improve source provider API (#399) 2021-04-06 20:26:51 -07:00
EJ Song edafcfeb7e
Check available index versions for Delta Lake time travel query (#389) 2021-04-04 22:34:59 -07:00
Gurleen Singh f9719862b7
Add hyperspace version to index log entry metadata (#367)
Co-authored-by: Terry Kim <yuminkim@gmail.com>
2021-04-04 22:18:48 -07:00
Terry Kim 1a03961034
Introduce "ResolvedColumn" to simplify handling resolved columns (#393) 2021-04-03 09:44:50 -07:00
Chungmin Lee 0bfb4120f2
Update scalastyle to allow 2021 in the copyright notice (#396) 2021-04-02 08:42:12 -07:00
Chungmin Lee 80d68cb6ee
Add unit tests for FileIdTracker (#394) 2021-03-31 20:15:50 -07:00
Chungmin Lee 2899d2acc0
Make IndexLogManager.getLatestLog final (#401) 2021-03-31 19:51:55 -07:00
Chungmin Lee c900cf5699
Minor refactoring: update Hyperspace to use ActiveSparkSession, etc. (#395) 2021-03-29 18:46:55 -07:00
Terry Kim 40c52431b7
Correctly pass HadoopConfiguration to Content.fromDirectory (#392) 2021-03-27 22:55:57 -07:00
Andrei Ionescu b28caca17f
Support index creation on nested fields (#379) 2021-03-27 11:26:49 -07:00
EJ Song 0843a37203
Add Delta Lake version history to IndexLogEntry for efficient time travel query (#272) 2021-03-21 23:17:45 -07:00
Apoorve Dave 3ccb0ea4df
[Gold Standard]: Initial code for spark only setup with a single query (#384) 2021-03-16 14:58:12 -07:00
Apoorve Dave dc3cf8f747
[Gold Standard] Add resources files for spark queries from spark's plan stability suite (#383) 2021-03-12 16:40:47 -08:00
EJ Song c5714e4fcd
Fix Iceberg lineage for Windows (#375) 2021-03-09 12:56:49 -08:00
EJ Song 2b229d4505
Fix azure-pipelines.yml to use ubuntu-18.04 (#371) 2021-03-02 19:20:13 -08:00
Terry Kim 66076e0fa4
Add a sbt-buildinfo plugin to generate BuildInfo object (#364) 2021-02-22 22:04:50 -08:00
Andrei Ionescu b5c9b46575
Fix for doc of lineagePairs method of IcebergRelation (#362) 2021-02-22 12:52:19 -08:00
Andrei Ionescu 29ebdde030
Support Iceberg table format (#358) 2021-02-22 09:14:11 -08:00
Terry Kim 0fef99705b
Introduce SourceRelation/FileBasedRelation traits to remove direct dependency on LogicalRelation from actions/rules (#355)
Co-authored-by: Andrei Ionescu <webdev.andrei@gmail.com>
2021-02-12 13:44:24 -08:00
Terry Kim 097eb0fcc2
Fix e2e tests on managed tables and enable external table tests. (#349) 2021-02-09 10:38:13 -08:00
EJ Song 88f1b43147
Add config to use bucketed scan for filter indexes (#329) 2021-02-06 00:30:15 -08:00
EJ Song 9ddf44b887
Update user documentation for quick refresh (#348) 2021-02-02 09:32:37 -08:00
Terry Kim c5ec640b11
Update developer list in build.sbt (#346) 2021-01-29 11:35:22 -08:00
Terry Kim 9e7d26dddd
Update home.md to reflect the 0.4.0 release (#344) 2021-01-29 11:08:01 -08:00
EJ Song 7a793f0fd2
Update user documentation for Delta Lake (#343) 2021-01-29 10:37:00 -08:00
EJ Song 5ea6c8a7b3
Update user documentation for Hybrid Scan threshold configs (#339) 2021-01-29 09:48:59 -08:00
Terry Kim 066fdbfccc Setting version to 0.5.0-SNAPSHOT 2021-01-29 09:41:44 -08:00
Terry Kim 4d4d3057ac Setting version to 0.4.0 2021-01-29 09:40:00 -08:00
EJ Song cd9a632e3a
Add new IndexLogEntryTags to cache InMemoryFileIndex (#324) 2021-01-28 16:54:28 -08:00