在微服务架构中,API网关作为系统的统一入口,承担着路由转发、权限校验、流量控制等重要职责。其中,API限流是保障系统稳定性的重要手段之一,能够有效防止系统因突发流量而过载。Spring Cloud Gateway作为Spring Cloud生态中的网关组件,提供了多种灵活的限流实现方式。本文将详细介绍三种常用的API限流实现方案,并分析其适用场景。
Spring Cloud Gateway内置了基于Redis的限流过滤器RequestRateLimiter
,它采用令牌桶算法实现分布式限流,适合多实例网关场景。
<dependency>
<groupId>org.springframework.bootgroupId>
<artifactId>spring-boot-starter-data-redis-reactiveartifactId>
dependency>
spring:
redis:
host: localhost
port: 6379
cloud:
gateway:
routes:
- id: order-service
uri: lb://order-service
predicates:
- Path=/api/orders/**
filters:
- name: RequestRateLimiter
args:
redis-rate-limiter.replenishRate: 50 # 每秒生成50个令牌
redis-rate-limiter.burstCapacity: 100 # 令牌桶最大容量
key-resolver: "#{@ipKeyResolver}" # 使用IP作为限流键
@Bean
public KeyResolver ipKeyResolver() {
return exchange -> Mono.just(
exchange.getRequest().getRemoteAddress().getAddress().getHostAddress()
);
}
@Configuration
public class RateLimitConfig {
@Bean
public RedisRateLimiter redisRateLimiter(ReactiveRedisTemplate<String, String> redisTemplate) {
return new RedisRateLimiter(redisTemplate,
(config, routeId) -> new RateLimiterConfig.Builder()
.setReplenishRate(config.getReplenishRate())
.setBurstCapacity(config.getBurstCapacity())
.build());
}
}
优点:
缺点:
对于单实例网关或不需要严格分布式限流的场景,可以使用Guava的RateLimiter实现高性能本地限流。
<dependency>
<groupId>com.google.guavagroupId>
<artifactId>guavaartifactId>
<version>31.1-jreversion>
dependency>
@Component
@Order(Ordered.HIGHEST_PRECEDENCE)
public class RateLimitFilter implements GlobalFilter {
// 针对不同路由设置不同限流策略
private final Map<String, RateLimiter> limiters = Map.of(
"user-service", RateLimiter.create(20.0), // 每秒20个请求
"order-service", RateLimiter.create(50.0) // 每秒50个请求
);
@Override
public Mono<Void> filter(ServerWebExchange exchange, GatewayFilterChain chain) {
String routeId = exchange.getAttribute(ServerWebExchangeUtils.GATEWAY_PREDICATE_ROUTE_ATTR);
RateLimiter limiter = limiters.get(routeId);
if (limiter != null && !limiter.tryAcquire()) {
exchange.getResponse().setStatusCode(HttpStatus.TOO_MANY_REQUESTS);
exchange.getResponse().getHeaders().add("Content-Type", "application/json");
String error = "{\"code\":429,\"message\":\"请求过于频繁,请稍后再试\"}";
DataBuffer buffer = exchange.getResponse().bufferFactory().wrap(error.getBytes());
return exchange.getResponse().writeWith(Mono.just(buffer));
}
return chain.filter(exchange);
}
}
优点:
缺点:
Sentinel是阿里巴巴开源的流量控制组件,提供了丰富的限流、熔断、系统保护功能,适合复杂场景。
<dependency>
<groupId>com.alibaba.cloudgroupId>
<artifactId>spring-cloud-starter-alibaba-sentinelartifactId>
<version>2021.0.4.0version>
dependency>
<dependency>
<groupId>com.alibaba.cloudgroupId>
<artifactId>spring-cloud-alibaba-sentinel-gatewayartifactId>
<version>2021.0.4.0version>
dependency>
spring:
cloud:
sentinel:
transport:
dashboard: localhost:8080 # Sentinel控制台地址
port: 8719
filter:
enabled: false # 关闭默认的Servlet过滤器
gateway:
enabled: true
order: -100 # 过滤器执行顺序
@PostConstruct
public void initRules() {
// API分组限流
initApiGroupRules();
// 热点参数限流
initParamFlowRules();
}
private void initApiGroupRules() {
Set<ApiDefinition> definitions = new HashSet<>();
ApiDefinition userApi = new ApiDefinition("user-api")
.setPredicateItems(new HashSet<>(Arrays.asList(
new ApiPathPredicateItem().setPattern("/api/user/**")
.setMatchStrategy(SentinelGatewayConstants.URL_MATCH_STRATEGY_PREFIX)
)));
definitions.add(userApi);
GatewayApiDefinitionManager.loadApiDefinitions(definitions);
Set<GatewayFlowRule> rules = new HashSet<>();
rules.add(new GatewayFlowRule("user-api")
.setResourceMode(SentinelGatewayConstants.RESOURCE_MODE_CUSTOM_API_NAME)
.setCount(100)
.setIntervalSec(1)
.setControlBehavior(RuleConstant.CONTROL_BEHAVIOR_RATE_LIMITER)
.setMaxQueueingTimeoutMs(500));
GatewayRuleManager.loadRules(rules);
}
private void initParamFlowRules() {
ParamFlowRule rule = new ParamFlowRule("user-service")
.setParamIdx(0)
.setCount(10)
.setGrade(RuleConstant.FLOW_GRADE_QPS);
ParamFlowRuleManager.loadRules(Collections.singletonList(rule));
}
@Configuration
public class SentinelConfig {
// 自定义异常处理
@Bean
@Order(Ordered.HIGHEST_PRECEDENCE)
public SentinelGatewayBlockExceptionHandler sentinelGatewayBlockExceptionHandler(
ObjectProvider<List<ViewResolver>> viewResolversProvider,
ObjectProvider<ServerCodecConfigurer> serverCodecConfigurer) {
return new CustomBlockExceptionHandler(
viewResolversProvider.getIfAvailable(Collections::emptyList),
serverCodecConfigurer.getIfAvailable(ServerCodecConfigurer::create));
}
// 自定义请求解析器
@Bean
public RequestOriginParser requestOriginParser() {
return exchange -> {
String origin = exchange.getRequest().getHeaders().getFirst("X-Origin");
return Optional.ofNullable(origin).orElse("default");
};
}
}
// 自定义异常响应
class CustomBlockExceptionHandler extends SentinelGatewayBlockExceptionHandler {
public CustomBlockExceptionHandler(List<ViewResolver> viewResolvers,
ServerCodecConfigurer serverCodecConfigurer) {
super(viewResolvers, serverCodecConfigurer);
}
@Override
public Mono<Void> handle(ServerWebExchange exchange, Throwable ex) {
if (ex instanceof BlockException) {
exchange.getResponse().getHeaders().add("Content-Type", "application/json");
String error = String.format("{\"code\":429,\"message\":\"服务限流,%s\"}",
((BlockException) ex).getRule().getResource());
DataBuffer buffer = exchange.getResponse().bufferFactory().wrap(error.getBytes());
return exchange.getResponse().writeWith(Mono.just(buffer));
}
return Mono.error(ex);
}
}
优点:
缺点:
方案 | 适用场景 | 性能 | 分布式支持 | 功能丰富度 |
---|---|---|---|---|
Redis限流 | 多实例网关,需要精确限流 | 中 | 支持 | 中 |
Guava限流 | 单实例网关,简单限流需求 | 高 | 不支持 | 低 |
Sentinel限流 | 复杂流量管控,生产环境 | 中高 | 支持 | 高 |
实际应用建议:
最佳实践: