Граф коммитов

108 Коммитов

Автор SHA1 Сообщение Дата
Mike Rys 440e36ab72 Improvements on Image Sample
1. Made Processor and FeatureExtractor less memory intensive
2. Added SetColumnIfExists extension method
3. Refactored some (not all yet) of the ImageOps code to support change
#1 and make code more natural.
2016-10-12 13:30:37 -07:00
Mike Rys 35113dd2b0 JSON Sample Data 2016-10-10 16:27:53 -07:00
Mike Rys 5c544a96da Updated Tweetanalysis Sample
Updated file set syntax to remove deprecated syntax and added null value
test in filter.
2016-09-27 17:28:25 -04:00
Mike Rys 03b98f2e30 Updated RangeReducer
Added example query to showcase predicate push through.
2016-09-27 17:26:54 -04:00
Mike Rys c2c14d628d Added a JSON sample project
Contains some sample scripts using the JSON sample functions with more
complex JSON examples.

Will need data and more comments in code.
2016-09-27 17:25:58 -04:00
Mike Rys 46403f6906 Added more examples for Image app sample
Includes a Processor and a feature extractor now. Also added more
comments to scripts and moved the constants into the Assembly.
2016-09-27 17:22:20 -04:00
Saveen Reddy 14d9314025 Merge pull request #55 from steventmayer/stemayer-StreamingJsonExtractor
Reduced Memory Footprint for JSON Extractor
2016-09-23 18:47:08 -07:00
Michael Rys 4567a846e3 Updated PARTITION syntax to final syntax.
PARTITIONED BY is now DISTRIBUTED BY
2016-09-23 14:11:41 -07:00
Michael Rys ad848ff7b0 updated to latest syntax regarding partitioning/distribution
PARTITIONED BY is now DISTRIBUTED BY
2016-09-23 14:10:33 -07:00
Steven Mayer 79f175865f Changed Json Extractor to streaming read into reading all into memory at once. 2016-09-22 11:26:06 -07:00
Michael Rys 03405b313e Updated PARTITION syntax to final syntax. 2016-09-21 23:59:59 -07:00
Michael Rys 0cc97d993c Fixed file set syntax.
{vid:*} -> {vid}
2016-09-16 01:16:16 -07:00
Mike Rys 85acecff2f Added link to blog post explaining registration 2016-08-25 23:48:10 -07:00
Mike Rys 93b3d5bc88 Fix a typo in comment 2016-08-25 11:40:52 -07:00
Mike Rys fb80448ac4 Add simple SQL Spatial type example
We will extend this sample over time.
2016-08-25 11:40:42 -07:00
Mike Rys dabd9fbd15 Added new Tweet set
Thanks to @AzureandChill for his contribution!
2016-08-25 11:39:49 -07:00
Mike Rys 16cafcd9f4 New Flexible Schema Extractor and some cleanup
Added new Flexible Schema Extractor sample with sample data.
Added USING clause to TweetAnalysis sample and updated syntax on CREATE
TABLE statement and file set pattern.
2016-08-15 01:20:03 -07:00
Florian Mader 521ed6c3e2 Update readme.md
Extractors.Csv(delimiter:'\b', quoting:false) doesn't work because deleimiter is not an argument (anymore?). Using .Csv() without delimiter argument also fails because json gets split into columns. Tsv() might have the same problem (depending on the input file) works for this demo, though. 
Also not defining an output causes an error.
2016-07-27 17:58:05 +02:00
rukmanig ffcf6bfe24 Optimized NestedJsonProcessing example 2016-07-20 14:10:16 -07:00
Mike Rys e1496b3385 Updated TweetAnalysis Example with new USING clause
Added USING clause to one of the files.
2016-07-15 18:29:22 -07:00
Mike Rys 5a3771da68 Update Newtonsoft Reference to v8.
Also reduce .Net V to 4.5 (from 4.5.2).
2016-07-14 14:04:50 -07:00
Rukmani Gopalan 943c4348d2 Modified UDAGG example and added new sample file and image files 2016-06-20 23:28:49 -07:00
rukmanig 453ccfce8d Merge pull request #44 from rukmanig/rukmanig-image
Adding simple extensibility examples
2016-06-20 18:15:17 -05:00
rukmanig ebc87efed2 Adding simple extensibility examples 2016-06-20 16:13:00 -07:00
rukmanig 01d91b3944 Merge pull request #43 from rukmanig/rukmanig-image
Add sample code to process images using U-SQL
2016-06-16 18:05:11 -05:00
rukmanig ed16800765 C:\Users\rukmanig\source\Repos\BigDataInternal\CustomCode_Usecases 2016-06-16 15:58:25 -07:00
rukmanig 96d57817d1 Adding link to the MSDN article for CREATE ASSEMBLY in the ReadMe 2016-06-16 15:38:17 -07:00
Mike Rys 4bb7175000 Added Range Reducer sample
This answers a stackoverflow question and adds the sample for the
related MSDN blog post.
2016-06-07 17:44:11 -07:00
Mike Rys f0decea3b4 Updated TweetAnalysis TVF example to infer the result type 2016-06-07 17:43:11 -07:00
rukmanig 6e76315097 Adding sample json files in Samples/Data and documentation file - README.md 2016-05-17 15:58:51 -07:00
rukmanig 5fad9d5077 Deleting README file, will upload a non binary version. 2016-05-17 08:41:20 -07:00
Rukmani Gopalan bd2f7afc1e Checking in sample code to process JSON files using U-SQL. 2016-05-17 08:10:47 -07:00
rukmanig 617a9d9ca9 Adding sample JSON files. 2016-05-16 14:11:36 -07:00
matt winkler b12549c35b Create small_radio_json.json 2016-05-02 11:09:26 -07:00
Marcelo Treviño 8d6b53c6a8 Fixes missing namespace 2016-04-11 13:59:48 -05:00
Mike Rys 67d2846938 Fixing some sample locations in AmbulanceDemo
MapPivoter is still not fixed
2016-04-06 12:26:34 -07:00
Mike Rys 5ebcca0150 Updating AmbulanceDemo Project to include actual UDO code and some cleanup
Added some updates based on recent improvements (e.g., multiple inserts
in same script).

Added U-SQL C# Project containing UDO implementation.

CAVEAT: MapPivoter is currently broken. Will be fixed in next check-in.
2016-04-06 12:16:07 -07:00
Mike Rys d202bfaf43 Added example for silent:true on built-in Extractors 2016-04-04 15:56:14 -07:00
Mike Rys 8fcc146d35 Moved Builtin-UDOs example up one folder level 2016-04-04 15:39:59 -07:00
Mike Rys 5290050efe Added Built-in Extractors and Outputters Demo Scripts
Includes examples for options and how to extract from a file that has
headers or comments
2016-04-04 11:20:22 -07:00
Mike Rys 88d660c075 Updated Tweet Analysis Sample data and scripts 2016-04-04 00:50:54 -07:00
Saveen Reddy 3f2ad40fb7 Removed incorrectly placed comma 2016-02-20 10:14:34 -08:00
Mark Garner 483a55e555 Fixed object names
Changed the type from MAP to SQL.MAP and ARRAY to SQL.ARRAY
2016-01-28 09:30:38 -06:00
Mike Rys c10e093c75 fixed some comments 2016-01-02 14:12:21 -08:00
Michael Rys 24bbffd90a Added README.md for HeaderOutputter 2016-01-02 14:11:46 -08:00
Michael Rys 6de2e0ff5f Updated Example README.md
Added HeaderOutputter
2016-01-02 13:54:51 -08:00
Mike Rys 9ad8a9da7b Added Custom Outputter that writes the column names
Added Custom Outputter that writes the column names and optionally their
types.

Writing the data is left to the reader.
2016-01-02 13:42:02 -08:00
Michael Rys adddb16d43 Create README.md for Tweets Samples 2015-12-14 22:54:53 -08:00
Michael Rys 8a1a409330 Create README.md for Tweets Sample Data 2015-12-14 22:37:42 -08:00
Michael Rys d2bbabf4de improved link 2015-12-14 22:33:37 -08:00
Mike Rys 00f66bda17 Updated Sample Readme 2015-12-14 22:29:59 -08:00
Mike Rys acf195ca50 Added TweetAnalysis Samples and aligned sample data folder structure to account sample data folder structure 2015-12-14 22:29:57 -08:00
Michael Rys b00fa2c982 Fixed typo in Readme 2015-12-10 18:48:28 -08:00
Mike Rys 3cc675a90c First part of GitHub cleanup
Added more samples from ProjectKona repo.
Moved sample data and HOL content from AzureDataLake to USQL repo.
2015-12-10 18:42:41 -08:00
matt winkler bb96a68bcb further READE updates 2015-10-27 21:09:18 -07:00
matt winkler 37d55fffc0 Minor tweaks 2015-10-27 20:57:36 -07:00
matt winkler 01bf882c95 updating readme.md 2015-10-27 20:54:27 -07:00
matt winkler 0cd7709f65 initial commit of xml and json samples from Nathan 2015-10-27 20:52:42 -07:00