docker搭建minio以及java使用

1minio簡潔

MinIO 是一款高性能、分布式的物件存盤系統. 它是一款軟體產品, 可以100%的運行在標準硬體，即X86等低成本機器也能夠很好的運行MinIO，

在這里插入圖片描述

MinIO與傳統的存盤和其他的物件存盤不同的是：它一開始就針對性能要求更高的私有云標準進行軟體架構設計，因為MinIO一開始就只為物件存盤而設計，所以他采用了更易用的方式進行設計，它能實作物件存盤所需要的全部功能，在性能上也更加強勁，它不會為了更多的業務功能而妥協，失去MinIO的易用性、高效性，這樣的結果所帶來的好處是：它能夠更簡單的實作局有彈性伸縮能力的原生物件存盤服務，

在這里插入圖片描述

MinIO在傳統物件存盤用例（例如輔助存盤，災難恢復和歸檔）方面表現出色，同時，它在機器學習、大資料、私有云、混合云等方面的存盤技術上也獨樹一幟，當然，也不排除資料分析、高性能應用負載、原生云的支持，

minio社區版本開源免費，在沒有預算使用oss的時候可以考慮使用，

2 docker搭建minio

minio是支持云原生的，所以直接講使用docker來搭建，當然也可以使用k8s，直接下載官方的chart使用即可，

在這里插入圖片描述

2.1 單節點

單節點可以直接使用docker run啟動即可

docker run \
  -p 9000:9000 \
  -p 9001:9001 \
  minio/minio server /data --console-address ":9001"

也可以使用docker-compose來運行，

撰寫docker-compose.yaml

version: '3'
services:
  minio:
    image: minio/minio
    hostname: "minio"
    ports:
      - 9000:9000 
      - 9001:9001
    environment:
      MINIO_ACCESS_KEY: admin #控制臺登錄賬號
      MINIO_SECRET_KEY: 12345678 #控制臺登錄密碼
    volumes:
      - ./data:/data      #存盤路徑         
      - ./config:/root/.minio/   #組態檔  
    command: server --console-address ':9001' /data  
    privileged: true
    restart: always

創建掛載的檔案目錄，運行docker-compos啟動，

docker-compser up -d

輸入ip:9001 輸入admin/12345678進入控制臺

在這里插入圖片描述

控制臺：

在這里插入圖片描述

創建bucket，就可以上傳檔案了，

在這里插入圖片描述

輸入名稱保存，

在這里插入圖片描述

可以配置，相關策略，這里就不說明了，

在這里插入圖片描述

可以上傳下載操物件檔案，

在這里插入圖片描述

2.2 多節點部署

多節點部署使用docker-compse來模擬，創建4個節點，每個節點掛載兩份資料，

撰寫docker-compose.yaml

version: '3'

# starts 4 docker containers running minio server instances.
# using nginx reverse proxy, load balancing, you can access
# it through port 9000.
services:
  minio1:
    image: minio/minio
    hostname: minio1
    volumes:
      - ./data1-1:/data1
      - ./data1-2:/data2
    expose:
      - "9000"
      - "9001"
    environment:
      MINIO_ROOT_USER: minio
      MINIO_ROOT_PASSWORD: minio123
    command: server --console-address ":9001" http://minio{1...4}/data{1...2}
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
      interval: 30s
      timeout: 20s
      retries: 3

  minio2:
    image: minio/minio
    hostname: minio2
    volumes:
      - ./data2-1:/data1
      - ./data2-2:/data2
    expose:
      - "9000"
      - "9001"
    environment:
      MINIO_ROOT_USER: minio
      MINIO_ROOT_PASSWORD: minio123
    command: server --console-address ":9001" http://minio{1...4}/data{1...2}
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
      interval: 30s
      timeout: 20s
      retries: 3

  minio3:
    image: minio/minio
    hostname: minio3
    volumes:
      - ./data3-1:/data1
      - ./data3-2:/data2
    expose:
      - "9000"
      - "9001"
    environment:
      MINIO_ROOT_USER: minio
      MINIO_ROOT_PASSWORD: minio123
    command: server --console-address ":9001" http://minio{1...4}/data{1...2}
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
      interval: 30s
      timeout: 20s
      retries: 3

  minio4:
    image: minio/minio
    hostname: minio4
    volumes:
      - ./data4-1:/data1
      - ./data4-2:/data2
    expose:
      - "9000"
      - "9001"
    environment:
      MINIO_ROOT_USER: minio
      MINIO_ROOT_PASSWORD: minio123
    command: server --console-address ":9001" http://minio{1...4}/data{1...2}
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
      interval: 30s
      timeout: 20s
      retries: 3

  nginx:
    image: nginx:1.19.2-alpine
    hostname: nginx
    volumes:
      - ./nginx.conf:/etc/nginx/nginx.conf:ro
    ports:
      - "9000:9000"
      - "9001:9001"
    depends_on:
      - minio1
      - minio2
      - minio3
      - minio4

創建掛載的對應的data目錄和nginx目錄，

使用nginx負載均衡4個節點，創建nginx.conf，

user  nginx;
worker_processes  auto;

error_log  /var/log/nginx/error.log warn;
pid        /var/run/nginx.pid;

events {
    worker_connections  4096;
}

http {
    include       /etc/nginx/mime.types;
    default_type  application/octet-stream;

    log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                      '$status $body_bytes_sent "$http_referer" '
                      '"$http_user_agent" "$http_x_forwarded_for"';

    access_log  /var/log/nginx/access.log  main;
    sendfile        on;
    keepalive_timeout  65;

    # include /etc/nginx/conf.d/*.conf;

    upstream minio {
        server minio1:9000;
        server minio2:9000;
        server minio3:9000;
        server minio4:9000;
    }

    upstream console {
        ip_hash;
        server minio1:9001;
        server minio2:9001;
        server minio3:9001;
        server minio4:9001;
    }

    server {
        listen       9000;
        listen  [::]:9000;
        server_name  localhost;

        # To allow special characters in headers
        ignore_invalid_headers off;
        # Allow any size file to be uploaded.
        # Set to a value such as 1000m; to restrict file size to a specific value
        client_max_body_size 0;
        # To disable buffering
        proxy_buffering off;

        location / {
            proxy_set_header Host $http_host;
            proxy_set_header X-Real-IP $remote_addr;
            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_set_header X-Forwarded-Proto $scheme;

            proxy_connect_timeout 300;
            # Default is HTTP/1, keepalive is only enabled in HTTP/1.1
            proxy_http_version 1.1;
            proxy_set_header Connection "";
            chunked_transfer_encoding off;

            proxy_pass http://minio;
        }
    }

    server {
        listen       9001;
        listen  [::]:9001;
        server_name  localhost;

        # To allow special characters in headers
        ignore_invalid_headers off;
        # Allow any size file to be uploaded.
        # Set to a value such as 1000m; to restrict file size to a specific value
        client_max_body_size 0;
        # To disable buffering
        proxy_buffering off;

        location / {
            proxy_set_header Host $http_host;
            proxy_set_header X-Real-IP $remote_addr;
            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_set_header X-Forwarded-Proto $scheme;
            proxy_set_header X-NginX-Proxy true;

            # This is necessary to pass the correct IP to be hashed
            real_ip_header X-Real-IP;

            proxy_connect_timeout 300;
            
            # To support websocket
            proxy_http_version 1.1;
            proxy_set_header Upgrade $http_upgrade;
            proxy_set_header Connection "upgrade";
            
            chunked_transfer_encoding off;

            proxy_pass http://console;
        }
    }
}

運行，

docker-compser up -d

然后進入控制臺，操作和單節點一樣，

3 java sdk使用minio

sdk使用minio要先獲取AccessKey和SecretKey，

在控制臺生成，

在這里插入圖片描述

專案pom檔案引入，

<dependency>
    <groupId>io.minio</groupId>
    <artifactId>minio</artifactId>
    <version>8.3.0</version>
</dependency>

撰寫上傳、下載、洗掉的介面，

package com.test.minio;

import javax.servlet.http.HttpServletResponse;
import java.io.InputStream;

/**
 * 存盤檔案
 *
 * @author jiangyulu
 */
public interface FileService {
    /**
     * 上傳檔案
     *
     * @param inputStream inputStream
     * @param fdsFileName    fdsFileName
     * @param img         img
     * @return UUID
     */
    String upload(InputStream inputStream, String fdsFileName, boolean img);


    /**
     * 下載檔案
     *
     * @param fdsFileName 檔案在fds中的名稱
     * @param fileName    重新指定的檔案名
     * @param response    response
     */
    void download(String fdsFileName, String fileName, HttpServletResponse response);

    /**
     * 洗掉
     *
     * @param fdsFileName fdsFileName
     */
    void delete(String fdsFileName);
}

寫實作類，

package com.test.minio.impl;


import com.test.minio.FileService;
import io.minio.*;
import lombok.extern.slf4j.Slf4j;
import org.apache.commons.io.IOUtils;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.stereotype.Service;

import javax.servlet.http.HttpServletResponse;
import java.io.IOException;
import java.io.InputStream;
import java.net.URLEncoder;
import java.util.UUID;


/**
 * @author jaingyulu
 */
@Slf4j
@Service("minio")
public class MinioFileServiceImpl implements FileService {

    @Value("{$minio.endpoint}")
    private String endpoint;

    @Value("{$minio.accessKeyId}")
    private String accessKeyId;

    @Value("{$minio.accessKeySecret}")
    private String accessKeySecret;

    @Value("{$minio.bucketName}")
    private String bucketName;


    @Override
    public String upload(InputStream inputStream, String fdsFileName, boolean img) {

        try {
            MinioClient minioClient =
                    MinioClient.builder()
                            .endpoint(endpoint)
                            .credentials(accessKeyId, accessKeySecret)
                            .build();

            boolean found =
                    minioClient.bucketExists(BucketExistsArgs.builder().bucket(bucketName).build());
            if (found) {
                log.info("Bucket already exists.");
            } else {
                minioClient.makeBucket(MakeBucketArgs.builder().bucket(bucketName).build());
            }

            if (!img) {
                minioClient.putObject(
                        PutObjectArgs.builder()
                                .bucket(bucketName)
                                .object(fdsFileName)
                                .stream(inputStream, inputStream.available(), -1)
                                .build());
            } else {
                minioClient.putObject(
                        PutObjectArgs.builder()
                                .bucket(bucketName)
                                .object(fdsFileName)
                                .stream(inputStream, inputStream.available(), -1)
                                .contentType("image/png")
                                .build());
            }

            inputStream.close();
        } catch (Exception e) {
            e.printStackTrace();
        }
        return UUID.randomUUID().toString();
    }

    @Override
    public void download(String fdsFileName, String fileName, HttpServletResponse response) {
        InputStream in = null;
        try {
            MinioClient minioClient =
                    MinioClient.builder()
                            .endpoint(endpoint)
                            .credentials(accessKeyId, accessKeySecret)
                            .build();
            StatObjectResponse objectStat = minioClient.statObject(StatObjectArgs.builder().bucket(bucketName).object(fdsFileName).build());
            response.setContentType(objectStat.contentType());
            //response.setContentType(MediaType.APPLICATION_OCTET_STREAM_VALUE);
            response.setHeader("Content-Disposition", "attachment;filename=" + URLEncoder.encode(fileName, "UTF-8"));
            in = minioClient.getObject(GetObjectArgs.builder().bucket(bucketName).object(fdsFileName).build());
            IOUtils.copy(in, response.getOutputStream());
        } catch (Exception e) {
            log.error(e.getMessage());
        } finally {
            if (in != null) {
                try {
                    in.close();
                } catch (IOException e) {
                    log.error(e.getMessage());
                }
            }
        }
    }

    @Override
    public void delete(String fdsFileName) {
        try {
            MinioClient minioClient =
                    MinioClient.builder()
                            .endpoint(endpoint)
                            .credentials(accessKeyId, accessKeySecret)
                            .build();
            minioClient.removeObject(RemoveObjectArgs.builder().bucket(bucketName).object(fdsFileName).build());
        } catch (Exception e) {
            e.printStackTrace();
        }
    }
}

以上完成了minio檔案操作的基本功能，其他功能可以查看官方的檔案，8.3.0版本sdk比起7.x的變化還是比較大的，

轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/300575.html

標籤：其他

上一篇：簡單五步安裝虛擬機下mySQL及配置等命令

下一篇：Docker 部署一個用 Python 撰寫的 Web 應用

docker搭建minio以及java sdk使用

docker搭建minio以及java使用

1minio簡潔

2 docker搭建minio

2.1 單節點

2.2 多節點部署

3 java sdk使用minio