azure-docs-sdk-java/docs-ref-services/preview/datalake.md

2.9 KiB

title description keywords ms.date ms.topic ms.devlang ms.service manager
Azure Data Lake Store libraries for Java Reference documentation for the Java Data Lake Store libraries Azure, Java, SDK, API, big data, data lake 06/21/2017 reference java data-lake-store douge

Azure Data Lake Store libraries for Java

Overview

Capture data of any size, type, and ingestion speed in a single place for analytics with Azure Data Lake Store.

To get started with Data Lake Store, see Get started with Azure Data Lake Store using Java.

Client library

Read and write files, set permissions and metadata, and manage files and directories in Data Lake Store with the client library.

Add a dependency to your Maven pom.xml file to use the client library in your project.

<dependency>
   <groupId>com.microsoft.azure</groupId>
   <artifactId>azure-data-lake-store-sdk</artifactId>
   <version>2.1.5</version>
</dependency>

Example

Create a Data Lake client from a fully qualified domain name and OAuth2 access token, then create a file in Data Lake and write to it.

// AccessTokenProvider provider = new ClientCredsTokenProvider(authTokenEndpoint, clientId, clientKey);
ADLStoreClient client = ADLStoreClient.createClient(accountFQDN, provider);

// create directory
client.createDirectory("/a/b/w");
        
// create file and write some content
String filename = "/a/b/c.txt";
OutputStream stream = client.createFile(filename, IfExists.OVERWRITE  );
PrintStream out = new PrintStream(stream);
for (int i = 1; i <= 10; i++) {
    out.println("This is line #" + i);
    out.format("This is the same line (%d), but using formatted output. %n", i);
}
out.close();

[!div class="nextstepaction"] Explore the Client APIs

Management API

Use the management API to manage Data Lake Store accounts, firewall rules, and trusted identity providers.

Add a dependency to your Maven pom.xml file to use the management API in your project.

<dependency>
    <groupId>com.microsoft.azure</groupId>
    <artifactId>azure-mgmt-datalake-store</artifactId>
    <version>1.0.0-beta1.3</version>
</dependency>

[!div class="nextstepaction"] Explore the Management APIs

Samples

Azure Data Lake Get Started

Explore more sample Java code for Azure Data Lake Store you can use in your apps.