最新Zookeeper:实现“分布式锁”的 Demo_zookeeper实现分布式锁demo,2024年最新大数据开发面试必问

img
img
img

既有适合小白学习的零基础资料,也有适合3年以上经验的小伙伴深入学习提升的进阶课程,涵盖了95%以上大数据知识点,真正体系化!

由于文件比较多,这里只是将部分目录截图出来,全套包含大厂面经、学习笔记、源码讲义、实战项目、大纲路线、讲解视频,并且后续会持续更新

需要这份系统化资料的朋友,可以戳这里获取

+ - * [1、关于 zookeeper “命名服务协调”](#1_zookeeper__15)
		* [2、Demo 设计](#2Demo__19)
		* [3、Demo 前提](#3Demo__27)
+ [二、代码实现](#_37)
+ - * [1、引用 Maven 依赖](#1_Maven__39)
		* [2、ConnectionWatcher 类创建 Zookeeper 连接](#2ConnectionWatcher__Zookeeper__50)
		* [3、ActiveKeyValueStore 类读写 Zookeeper 数据](#3ActiveKeyValueStore__Zookeeper__86)
		* [4、ZkLock 类实现分布式锁](#4ZkLock__212)
+ [三、测试结果](#_297)

一、Demo 概述

1、关于 zookeeper “命名服务协调”

Zookeeper 能保证数据的强一致性,用户任何时候都可以相信集群中每个节点的数据都是相同的。一个用户创建一个节点作为锁,另一个用户检测该节点,如果存在,代表别的用户已经锁住,如果不存在,则可以创建一个节点,代表拥有一个锁。

2、Demo 设计

分布式锁本质,就是多个资源竞争者对一份资源的排他占有

  • 我们设置多个线程,分别在同一 path 下创建节点
  • 没个线程获取当前 path 下子节点,看最小子节点是否为自身,是则加锁成功(更好的方式是用 Watcher 对前一个地址监控,这里图方便用子节点排序取最小的方式 )
  • 线程加锁成功后,执行任务,执行完毕后解锁
3、Demo 前提

参考:Mac通过Docker安装Zookeeper集群


二、代码实现

1、引用 Maven 依赖
        <!-- 选择对应的Zookeeper版本 -->
        <dependency>
            <groupId>org.apache.zookeeper</groupId>
            <artifactId>zookeeper</artifactId>
            <version>3.7.0</version>
        </dependency>

2、ConnectionWatcher 类创建 Zookeeper 连接
import java.io.IOException;
import java.util.concurrent.CountDownLatch;

import org.apache.zookeeper.WatchedEvent;
import org.apache.zookeeper.Watcher;
import org.apache.zookeeper.ZooKeeper;

public class ConnectionWatcher implements Watcher {

    private final CountDownLatch connectedSignal = new CountDownLatch(1);
    private static final int SESSION\_TIMEOUT = 5000;
    protected ZooKeeper zk;


    public void connect(String hosts) throws IOException, InterruptedException {
        zk = new ZooKeeper(hosts, SESSION\_TIMEOUT, this);
        connectedSignal.await();
    }

    @Override
    public void process(WatchedEvent event) {
        if (event.getState() == Event.KeeperState.SyncConnected) {
            connectedSignal.countDown();
        }
    }

    public void close() throws InterruptedException {
        zk.close();
    }

}

3、ActiveKeyValueStore 类读写 Zookeeper 数据
import java.nio.charset.Charset;
import java.nio.charset.StandardCharsets;
import java.util.List;

import org.apache.zookeeper.CreateMode;
import org.apache.zookeeper.KeeperException;
import org.apache.zookeeper.Watcher;
import org.apache.zookeeper.ZooDefs;
import org.apache.zookeeper.data.Stat;

public class ActiveKeyValueStore extends ConnectionWatcher {

    private static final Charset CHARSET = StandardCharsets.UTF\_8;

    int state = 0;

    /\*\*
 \* 写入节点数据
 \*
 \* @param path 节点地址
 \* @param value 数据值
 \* @throws InterruptedException 中断异常
 \* @throws KeeperException ZooKeeper异常
 \*/
    public void write(String path, String value) throws InterruptedException, KeeperException {
        Stat stat = zk.exists(path, false);
        if (stat == null) {
            if (value == null) {
                zk.create(path, null,
                        ZooDefs.Ids.OPEN\_ACL\_UNSAFE, CreateMode.PERSISTENT);
            } else {
                zk.create(path, value.getBytes(CHARSET),
                        ZooDefs.Ids.OPEN\_ACL\_UNSAFE, CreateMode.PERSISTENT);
            }

        } else {
            if (value == null) {
                zk.setData(path, null, -1);
            } else {
                zk.setData(path, value.getBytes(CHARSET), -1);
            }

        }
    }
  
   public boolean lock(String path, String name) throws InterruptedException, KeeperException {
        boolean flag = tryLock(path, name);
        if (flag) {
            state++;
        }
        return flag;
    }

    public boolean tryLock(String path, String name) throws InterruptedException, KeeperException {

        String lockPath = path + "/" + name;
        zk.create(lockPath, null, ZooDefs.Ids.OPEN\_ACL\_UNSAFE, CreateMode.EPHEMERAL);

        List<String> waits = readChildren(path, null);
        Collections.sort(waits);
        if (waits.get(0).equals(name)) {
            return true;
        }
        CountDownLatch latch = new CountDownLatch(1);
        for (int i = 0; i < waits.size(); i++) {
            String cur = waits.get(i);
            if (!cur.equalsIgnoreCase(name)) {
                continue;
            }
            String prePath = path + "/" + waits.get(i - 1);
            zk.exists(prePath, new Watcher() {
                @Override
                public void process(WatchedEvent event) {
                    latch.countDown();
                }
            });
            break;
        }
        latch.await();
        return true;
    }

    public boolean unlock(String path, String name) {
        if (state > 1) {
            state--;
            return true;
        }

        String lockPath = path + "/" + name;

        try {
            Stat stat = zk.exists(lockPath, false);
            int version = stat.getVersion();
            zk.delete(lockPath, version);
            state--;
            return true;
        } catch (Exception e) {
            System.out.println("unlock:" + lockPath + " ,exception,");
        }
        return false;
    }

    /\*\*
 \* 获取所有子节点
 \*
 \* @param path 节点地址
 \* @param watcher watcher
 \* @return 所有子节点
 \* @throws InterruptedException 中断异常
 \* @throws KeeperException ZooKeeper异常
 \*/
    public List<String> readChildren(String path, Watcher watcher) throws InterruptedException, KeeperException {
        List<String> childrens = null;
        if (watcher == null) {
            childrens = zk.getChildren(path, false);
        } else {
            childrens = zk.getChildren(path, watcher, null);


![img](https://img-blog.csdnimg.cn/img_convert/5149384ce88699f55a8e0dd75e581a72.png)
![img](https://img-blog.csdnimg.cn/img_convert/8fe43351f60ebe25e06e03f968c485ca.png)
![img](https://img-blog.csdnimg.cn/img_convert/841c2fe32d16eb8c048c40c4e33f5de1.png)

**既有适合小白学习的零基础资料,也有适合3年以上经验的小伙伴深入学习提升的进阶课程,涵盖了95%以上大数据知识点,真正体系化!**

**由于文件比较多,这里只是将部分目录截图出来,全套包含大厂面经、学习笔记、源码讲义、实战项目、大纲路线、讲解视频,并且后续会持续更新**

**[需要这份系统化资料的朋友,可以戳这里获取](https://bbs.csdn.net/topics/618545628)**

片转存中...(img-uJuIuPAY-1715813617773)]

**既有适合小白学习的零基础资料,也有适合3年以上经验的小伙伴深入学习提升的进阶课程,涵盖了95%以上大数据知识点,真正体系化!**

**由于文件比较多,这里只是将部分目录截图出来,全套包含大厂面经、学习笔记、源码讲义、实战项目、大纲路线、讲解视频,并且后续会持续更新**

**[需要这份系统化资料的朋友,可以戳这里获取](https://bbs.csdn.net/topics/618545628)**

  • 3
    点赞
  • 4
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
以下是一个基于 ZooKeeper 实现分布式锁的 Java Demo: ```java import java.util.concurrent.CountDownLatch; import org.apache.zookeeper.CreateMode; import org.apache.zookeeper.KeeperException; import org.apache.zookeeper.WatchedEvent; import org.apache.zookeeper.Watcher; import org.apache.zookeeper.ZooDefs.Ids; import org.apache.zookeeper.ZooKeeper; import org.apache.zookeeper.data.Stat; public class DistributedLock implements Watcher { private static final String ZK_ADDRESS = "localhost:2181"; private static final int SESSION_TIMEOUT = 5000; private static final String LOCK_ROOT = "/locks"; private static final String LOCK_PREFIX = "lock_"; private String lockPath; private ZooKeeper zk; private CountDownLatch connectedSignal = new CountDownLatch(1); private CountDownLatch lockSignal = new CountDownLatch(1); public DistributedLock() throws Exception { zk = new ZooKeeper(ZK_ADDRESS, SESSION_TIMEOUT, this); connectedSignal.await(); Stat stat = zk.exists(LOCK_ROOT, false); if (stat == null) { zk.create(LOCK_ROOT, new byte[0], Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT); } } public boolean lock() throws Exception { lockPath = zk.create(LOCK_ROOT + "/" + LOCK_PREFIX, new byte[0], Ids.OPEN_ACL_UNSAFE, CreateMode.EPHEMERAL_SEQUENTIAL); while (true) { String prevLock = getPrevLock(); if (prevLock == null) { return true; } else { zk.exists(prevLock, true); lockSignal.await(); } } } public void unlock() throws Exception { zk.delete(lockPath, -1); } private String getPrevLock() throws KeeperException, InterruptedException { String prevLock = null; String[] nodes = zk.getChildren(LOCK_ROOT, false).toArray(new String[0]); for (int i = 0; i < nodes.length; i++) { if (lockPath.endsWith(nodes[i])) { if (i > 0) { prevLock = LOCK_ROOT + "/" + nodes[i - 1]; } break; } } return prevLock; } @Override public void process(WatchedEvent event) { if (event.getState() == Event.KeeperState.SyncConnected) { connectedSignal.countDown(); } else if (event.getType() == Event.EventType.NodeDeleted && event.getPath().equals(getPrevLock())) { lockSignal.countDown(); } } } ``` 这个 Demo 中,`DistributedLock` 类实现分布式锁的基本操作。使用时,首先需要创建一个 `DistributedLock` 对象,然后调用 `lock` 方法获取锁,调用 `unlock` 方法释放锁。 这个 Demo 中使用 ZooKeeper 的 `EPHEMERAL_SEQUENTIAL` 模式创建了一个临时顺序节点,如果当前节点是序号最小的节点,则获取到锁。如果不是,则在当前节点的前一个节点上注册一个 Watcher,当前一个节点被删除时,当前节点就可以获取到锁了。 需要注意的是,这个 Demo 中的锁并没有考虑超时问题。在实际使用中,需要根据具体情况进行优化。
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值