面試官:你是如何使用JDK來實(shí)現(xiàn)自己的緩存(支持高并發(fā))?
需求分析
項(xiàng)目中經(jīng)常會(huì)遇到這種場(chǎng)景:一份數(shù)據(jù)需要在多處共享,有些數(shù)據(jù)還有時(shí)效性,過期自動(dòng)失效。比如手機(jī)驗(yàn)證碼,發(fā)送之后需要緩存起來,然后處于安全性考慮,一般還要設(shè)置有效期,到期自動(dòng)失效。我們?cè)趺磳?shí)現(xiàn)這樣的功能呢?
解決方案
- 使用現(xiàn)有的緩存技術(shù)框架,比如redis,ehcache。優(yōu)點(diǎn):成熟,穩(wěn)定,功能強(qiáng)大;缺點(diǎn),項(xiàng)目需要引入對(duì)應(yīng)的框架,不夠輕量。
- 如果不考慮分布式,只是在單線程或者多線程間作數(shù)據(jù)緩存,其實(shí)完全可以自己手寫一個(gè)緩存工具。下面就來簡(jiǎn)單實(shí)現(xiàn)一個(gè)這樣的工具。
先上代碼:
- import java.util.HashMap;
- import java.util.Map;
- import java.util.concurrent.*;
- /**
- * @Author: lixk
- * @Date: 2018/5/9 15:03
- * @Description: 簡(jiǎn)單的內(nèi)存緩存工具類
- */
- public class Cache {
- //鍵值對(duì)集合
- private final static Map<String, Entity> map = new HashMap<>();
- //定時(shí)器線程池,用于清除過期緩存
- private final static ScheduledExecutorService executor = Executors.newSingleThreadScheduledExecutor();
- /**
- * 添加緩存
- *
- * @param key 鍵
- * @param data 值
- */
- public synchronized static void put(String key, Object data) {
- Cache.put(key, data, 0);
- }
- /**
- * 添加緩存
- *
- * @param key 鍵
- * @param data 值
- * @param expire 過期時(shí)間,單位:毫秒, 0表示***長(zhǎng)
- */
- public synchronized static void put(String key, Object data, long expire) {
- //清除原鍵值對(duì)
- Cache.remove(key);
- //設(shè)置過期時(shí)間
- if (expire > 0) {
- Future future = executor.schedule(new Runnable() {
- @Override
- public void run() {
- //過期后清除該鍵值對(duì)
- synchronized (Cache.class) {
- map.remove(key);
- }
- }
- }, expire, TimeUnit.MILLISECONDS);
- map.put(key, new Entity(data, future));
- } else {
- //不設(shè)置過期時(shí)間
- map.put(key, new Entity(data, null));
- }
- }
- /**
- * 讀取緩存
- *
- * @param key 鍵
- * @return
- */
- public synchronized static Object get(String key) {
- Entity entity = map.get(key);
- return entity == null ? null : entity.getValue();
- }
- /**
- * 讀取緩存
- *
- * @param key 鍵
- * * @param clazz 值類型
- * @return
- */
- public synchronized static <T> T get(String key, Class<T> clazz) {
- return clazz.cast(Cache.get(key));
- }
- /**
- * 清除緩存
- *
- * @param key
- * @return
- */
- public synchronized static Object remove(String key) {
- //清除原緩存數(shù)據(jù)
- Entity entity = map.remove(key);
- if (entity == null) return null;
- //清除原鍵值對(duì)定時(shí)器
- Future future = entity.getFuture();
- if (future != null) future.cancel(true);
- return entity.getValue();
- }
- /**
- * 查詢當(dāng)前緩存的鍵值對(duì)數(shù)量
- *
- * @return
- */
- public synchronized static int size() {
- return map.size();
- }
- /**
- * 緩存實(shí)體類
- */
- private static class Entity {
- //鍵值對(duì)的value
- private Object value;
- //定時(shí)器Future
- private Future future;
- public Entity(Object value, Future future) {
- this.value = value;
- this.future = future;
- }
- /**
- * 獲取值
- *
- * @return
- */
- public Object getValue() {
- return value;
- }
- /**
- * 獲取Future對(duì)象
- *
- * @return
- */
- public Future getFuture() {
- return future;
- }
- }
- }
本工具類主要采用 HashMap+定時(shí)器線程池 實(shí)現(xiàn),map 用于存儲(chǔ)鍵值對(duì)數(shù)據(jù),map的value是 Cache 的內(nèi)部類對(duì)象 Entity,Entity 包含 value 和該鍵值對(duì)的生命周期定時(shí)器 Future。Cache 類對(duì)外只提供了 put(key, value), put(key, value, expire), get(key), get(key, class), remove(key), size()幾個(gè)同步方法。
當(dāng)添加鍵值對(duì)數(shù)據(jù)的時(shí)候,首先會(huì)調(diào)用remove()方法,清除掉原來相同 key 的數(shù)據(jù),并取消對(duì)應(yīng)的定時(shí)清除任務(wù),然后添加新數(shù)據(jù)到 map 中,并且,如果設(shè)置了有效時(shí)間,則添加對(duì)應(yīng)的定時(shí)清除任務(wù)到定時(shí)器線程池。
測(cè)試
- import java.util.concurrent.ExecutionException;
- import java.util.concurrent.ExecutorService;
- import java.util.concurrent.Executors;
- import java.util.concurrent.Future;
- /**
- * @Author: lixk
- * @Date: 2018/5/9 16:40
- * @Description: 緩存工具類測(cè)試
- */
- public class CacheTest {
- /**
- * 測(cè)試
- *
- * @param args
- */
- public static void main(String[] args) throws InterruptedException, ExecutionException {
- String key = "id";
- //不設(shè)置過期時(shí)間
- System.out.println("***********不設(shè)置過期時(shí)間**********");
- Cache.put(key, 123);
- System.out.println("key:" + key + ", value:" + Cache.get(key));
- System.out.println("key:" + key + ", value:" + Cache.remove(key));
- System.out.println("key:" + key + ", value:" + Cache.get(key));
- //設(shè)置過期時(shí)間
- System.out.println("
- ***********設(shè)置過期時(shí)間**********");
- Cache.put(key, "123456", 1000);
- System.out.println("key:" + key + ", value:" + Cache.get(key));
- Thread.sleep(2000);
- System.out.println("key:" + key + ", value:" + Cache.get(key));
- /******************并發(fā)性能測(cè)試************/
- System.out.println("
- ***********并發(fā)性能測(cè)試************");
- //創(chuàng)建有10個(gè)線程的線程池,將1000000次操作分10次添加到線程池
- ExecutorService executorService = Executors.newFixedThreadPool(10);
- Future[] futures = new Future[10];
- /********添加********/
- {
- long start = System.currentTimeMillis();
- for (int j = 0; j < 10; j++) {
- futures[j] = executorService.submit(() -> {
- for (int i = 0; i < 100000; i++) {
- Cache.put(Thread.currentThread().getId() + key + i, i, 300000);
- }
- });
- }
- //等待全部線程執(zhí)行完成,打印執(zhí)行時(shí)間
- for (Future future : futures) {
- future.get();
- }
- System.out.printf("添加耗時(shí):%dms
- ", System.currentTimeMillis() - start);
- }
- /********查詢********/
- {
- long start = System.currentTimeMillis();
- for (int j = 0; j < 10; j++) {
- futures[j] = executorService.submit(() -> {
- for (int i = 0; i < 100000; i++) {
- Cache.get(Thread.currentThread().getId() + key + i);
- }
- });
- }
- //等待全部線程執(zhí)行完成,打印執(zhí)行時(shí)間
- for (Future future : futures) {
- future.get();
- }
- System.out.printf("查詢耗時(shí):%dms
- ", System.currentTimeMillis() - start);
- }
- System.out.println("當(dāng)前緩存容量:" + Cache.size());
- }
- }
測(cè)試結(jié)果:
- ***********不設(shè)置過期時(shí)間**********
- key:id, value:123
- key:id, value:123
- key:id, value:null
- ***********設(shè)置過期時(shí)間**********
- key:id, value:123456
- key:id, value:null
- ***********并發(fā)性能測(cè)試************
- 添加耗時(shí):2313ms
- 查詢耗時(shí):335ms
- 當(dāng)前緩存容量:1000000
測(cè)試程序使用有10個(gè)線程的線程池來模擬并發(fā),總共執(zhí)行一百萬(wàn)次添加和查詢操作,時(shí)間大約都在兩秒多,表現(xiàn)還不錯(cuò),每秒40萬(wàn)讀寫并發(fā)應(yīng)該還是可以滿足大多數(shù)高并發(fā)場(chǎng)景的^_^