3a2f09767d
Update build.sbt ( #163 )
...
Update build.sbt version to spark3.3-1.19.7
2024-06-12 15:15:52 -07:00
e21c6839cb
Update README.md
2024-04-08 11:08:13 -07:00
34d5cab128
Update to version spark3.3-1.19.7 ( #161 )
2024-04-05 18:50:39 -07:00
23f01a1772
Revert "Spark 3: Cache CDM Date and DateTime type methods ( #100 )" ( #160 )
...
This reverts commit 14048081dc
2024-04-05 18:47:27 -07:00
881b514e94
Spark 3.3 Update CDM library to 1.7.3 ( #159 )
2024-04-05 18:45:19 -07:00
28e1e1e48a
Spark 3.3 Disable noisy test ( #158 )
2024-04-05 18:38:53 -07:00
ebe4b24f13
Create LICENSE ( #140 )
2023-03-24 17:54:57 -07:00
2fe91231af
Release spark3.3-1.19.5 ( #137 )
2023-03-14 14:05:43 -07:00
32517aa73b
Disable blank issues ( #136 )
2023-02-13 13:45:44 -08:00
85978f4b8f
Update docs ( #133 )
2023-02-03 19:54:36 -08:00
a846481a35
Update bug_report.yml
2023-01-19 13:46:01 -08:00
879089d49c
Update bug_report.yml
2023-01-18 15:38:17 -08:00
8cea3ed563
Update bug_report.yml
2023-01-10 12:58:13 -08:00
648fa02c0c
Update docs ( #125 )
2023-01-10 11:55:37 -08:00
b1be616fae
Update bug_report.yml ( #128 )
2023-01-10 11:53:26 -08:00
d24309732e
Add issue template ( #126 )
2023-01-09 23:07:19 -08:00
4d7cf4c6e4
Create .gitignore ( #116 )
2022-12-02 14:33:24 -08:00
e92d307264
Update spark3.2-1.19.4 ( #110 )
2022-12-02 14:19:22 -08:00
3ce0937aee
Update version spark3.2-1.19.3 ( #105 )
2022-10-08 21:49:14 -07:00
abe17b8f7b
Microsoft mandatory file ( #97 )
...
Co-authored-by: microsoft-github-policy-service[bot] <77245923+microsoft-github-policy-service[bot]@users.noreply.github.com>
2022-10-05 23:30:11 -07:00
96feca721d
Update version to 1.19.3 ( #103 )
2022-10-04 20:01:44 -07:00
2746d67485
Spark 3: Support SAS token based authentication ( #101 )
...
Support SAS based token auth.
2022-10-04 20:01:44 -07:00
14048081dc
Spark 3: Cache CDM Date and DateTime type methods ( #100 )
...
Cache the Date and DateTime methods by reading the first row and then mapping **index** to a **(format, function)** tuple. On a subsequent read, the executor will automatically pass in the index, and if it's a CDM Date or DateTime type, it will use the map to directly use the cached method to parse all future inputs. This increases the scalability and performance by selecting the right function to execute in constant O(1) time vs O(N) time, where N is the number of formats needed to check.
**Restrictions:**
- Each column must have the same format, otherwise an exception will be thrown (when using failfast). If permissive mode is used, then those with a different format will be turned into null
2022-10-04 20:01:44 -07:00
e51fc89930
Prepare Documentation for GA ( #87 )
2022-02-08 11:39:53 -08:00
0ca65cf90f
Add files via upload
2021-10-27 09:40:28 -07:00
4757beeacd
merge spark3 source to master ( #85 )
2021-10-26 11:17:21 -07:00
4ac54bda3b
Add files via upload
2021-03-09 15:51:47 -08:00
71672418ff
Update overview.md to document permissive|failfast mode
2021-02-10 21:33:28 -08:00
4b821eede0
Connector version 0.19
2021-02-10 21:20:35 -08:00
603fcd880f
Add files via upload
2021-01-25 12:08:29 -08:00
573590432c
Delete spark-cdm-connector-assembly-permissive.jar
2021-01-25 12:07:37 -08:00
af4a855c11
Add files via upload
2021-01-21 23:26:01 -08:00
ee01ada722
Add files via upload
2021-01-21 23:24:41 -08:00
8a87865e98
Add files via upload
2021-01-21 23:13:03 -08:00
5c564cfac1
Add files via upload
2020-12-10 00:27:42 -08:00
c0ad792a22
doc update
2020-12-09 22:43:51 -08:00
f1aa320e25
doc update
2020-12-09 22:41:44 -08:00
e98d0b14d3
0.18.2 release
2020-12-09 22:20:35 -08:00
7d3a865842
fix minor typos
2020-12-09 18:19:25 -08:00
79cb3e2535
Test jarwith maxCDMThreads for storageManager
2020-12-01 09:35:18 -08:00
2b12e935c9
test dir
2020-12-01 09:34:17 -08:00
89b0ce2cd0
Update overview.md
2020-11-20 15:01:46 -08:00
1445a95d54
Update overview.md
2020-11-13 13:31:03 -08:00
af3664a8a3
Update overview.md
2020-11-13 13:26:09 -08:00
9b8423fab9
Merge pull request #55 from Azure/bg-public-preview
...
Update overview.md
2020-10-27 11:29:17 -07:00
8766336ef6
Update overview.md
2020-10-27 11:27:11 -07:00
418c48d424
Add files via upload
2020-10-27 10:09:41 -07:00
34d85e8bbd
Update overview.md
2020-09-30 00:21:01 -07:00
b9fed94983
Merge pull request #51 from Azure/bg-overview
...
Update overview.md
2020-09-29 23:12:43 -07:00
e39c1e8fa6
Update overview.md
2020-09-29 23:11:56 -07:00
kecheung
microsoft-github-policy-service[bot]
kcheeeung
bissont
bissont
bissont
Sricheta Ruj
Bill Gibson