radosgwadmin4j

A Ceph Object Storage Admin SDK / Client Library for Java

Download .zip Download .tar.gz

About

radosgw-admin4j is a powerful Ceph object storage admin client designed for provisioning and managing Ceph object storage deployments. It offers a wide range of features, including user and subuser management, quota control, usage reporting, and bucket/object management, among others.

Highlights

Full Support for All Operations: We fully support all operations, including subuser and quota management, for the latest Ceph versions.
Simplified Radosgw Management: Manage your radosgw instance with ease, avoiding the complexities often associated with radosgw admin APIs.
Quality and Compatibility: Our codebase undergoes continuous integration and testing against active Ceph releases, including Octopus, Pacific, Quincy, and Reef.
Contributor-Friendly: We welcome contributions with a straightforward contribution process and no unusual policies.

Getting Started

Add Dependency

You can include radosgw-admin4j in your project by adding the following Maven Central dependency:

<dependency>
    <groupId>io.github.twonote</groupId>
    <artifactId>radosgw-admin4j</artifactId>
    <version>2.0.9</version> <!-- Replace with the latest version -->
</dependency>

Configuration

RgwAdmin rgwAdmin = new RgwAdminBuilder()
    .accessKey("administrator access key")
    .secretKey("administrator secret key")
    .endpoint("radosgw admin endpoint, e.g., http://127.0.0.1:8080/admin")
    .build();

Usage Example

We offer a comprehensive set of operations, including User, Subuser, Key, Bucket, Capability, Quota, and Usage. Please refer to the for all available operations.

User Management

// List users in the system
List<User> users = rgwAdmin.listUserInfo();

// Create a user
rgwAdmin.createUser(userId);

// Get user information and display keys
User user = rgwAdmin.getUserInfo(userId).get();
user.getS3Credentials().forEach(System.out::println);

// Create a subuser
SubUser subUser = rgwAdmin.createSubUser(userId, "subUserId", SubUser.Permission.FULL, CredentialType.SWIFT);

// Suspend a user
rgwAdmin.suspendUser(userId, true);

// Remove a user
rgwAdmin.removeUser(userId);

Quota Management

// Allow the user to own more buckets
rgwAdmin.modifyUser(userId, ImmutableMap.of("max-buckets", String.valueOf(Integer.MAX_VALUE)));

// Set a quota that limits the user to a maximum of one thousand objects and a maximum usage of 1 GiB
rgwAdmin.setUserQuota(userId, 1000, 1048576);

Bucket Management

// Transfer the bucket ownership from the user to the administrator
BucketInfo bucketInfo = rgwAdmin.getBucketInfo(bucketName).get();
rgwAdmin.linkBucket(bucketName, bucketInfo.getId(), adminUserId);

// Remove a bucket
rgwAdmin.removeBucket(bucketName);

Usage Report

// Retrieve and display the usage report for a given user
UsageInfo userUsage = rgwAdmin.getUserUsage(userId).get();
userUsage.getSummary().forEach(System.out::println);

One More Thing: Radosgw Setup

To get started, you need a ready-to-use radosgw instance and an admin account with the necessary capabilities. Here’s how you can set up a radosgw instance:

If You Don’t Have a Radosgw Setup

You can refer to the Ceph official manual for a quick Ceph cluster setup. If you’re not familiar with Ceph, this may be a bit challenging. An easier approach is available if you have Docker in your environment. To set up a standalone instance with an admin account using the Ceph daemon Docker image, follow these instructions:
```
$ docker run -d -p 80:8080 -v /etc/ceph/:/etc/ceph/ -e CEPH_DEMO_UID=qqq -e CEPH_DEMO_ACCESS_KEY=qqq -e CEPH_DEMO_SECRET_KEY=qqq -e NETWORK_AUTO_DETECT=4 --name rgw ceph/daemon:v6.0.3-stable-6.0-pacific-centos-8-x86_64 demo
```
Note that port 80 should be available.
It takes about two minutes to initialize the Ceph cluster. Check if the setup succeeded with the following command:
```
$ timeout 120 bash -c "until docker logs rgw &> rgw.log && grep SUCCESS rgw.log; do sleep 1; done"
```
Once the setup is complete, you can run radosgw-admin4j tests without any additional configuration on the client side since the default config should suffice. Run tests with the following commands:
```
$ git clone https://github.com/twonote/radosgw-admin4j.git
$ cd radosgw-admin4j
$ mvn test
```

If You Already Have a Radosgw Instance

First, ensure you have an admin account. If not, create the account with the following commands:

$ radosgw-admin user create --uid=qqq --display-name="qqq" --access-key=qqq --secret-key=qqq
$ radosgw-admin --id admin caps add --caps="buckets=*;users=*;usage=*;metadata=*" --uid=qqq

Enter the key pair (qqq,qqq) and add your radosgw endpoint to the config file.
Note that radosgw does not enable usage log by default. If you need this feature or plan to run test cases, make sure you enable the usage log in your Ceph config file. For example, in your ceph.conf:
```
...
[client.radosgw.gateway]
rgw enable usage log = true
rgw usage log tick interval = 1
rgw usage log flush threshold = 1
rgw usage max shards = 32
rgw usage max user shards = 1
...
```

That’s it!

Contributing

We welcome all contributions to the project. Our code style follows the Google Java Style Guide, and we use google-java-format for code formatting. There are no unusual policies, and we encourage you to get involved.

Legal

Licensed under the Apache License, Version 2.0. You may not use this file except in compliance with the License. You can obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, without warranties or conditions of any kind, either express or implied. See the License for the specific language governing permissions and limitations under the License.