xiaoxia
e0c3bae072
CI/CD Pipeline / Check if frontend-only change (push) Has been skipped
CI/CD Pipeline / PR Build API Image (push) Has been skipped
CI/CD Pipeline / PR Build Web Image (push) Has been skipped
CI/CD Pipeline / PR Build Worker Image (push) Has been skipped
CI/CD Pipeline / Frontend Lint (push) Successful in 44s
CI/CD Pipeline / Build Staging Web Image (push) Successful in 1m11s
CI/CD Pipeline / Build Production API Image (push) Has been skipped
CI/CD Pipeline / Build Production Web Image (push) Has been skipped
CI/CD Pipeline / Build Production Worker Image (push) Has been skipped
Worker Base Image Build / Build Worker Base Images (worker-base-builder-cache, infra/docker/worker-base-builder.Dockerfile, worker-base-builder, builder) (push) Failing after 3m41s
Worker Base Image Build / Build Worker Base Images (worker-base-runtime-cache, infra/docker/worker-base-runtime.Dockerfile, worker-base-runtime, runtime) (push) Failing after 1m11s
CI/CD Pipeline / Deploy Production (push) Has been skipped
CI/CD Pipeline / Build Staging Worker Image (push) Failing after 4m40s
CI/CD Pipeline / Production Browser E2E (push) Has been skipped
CI/CD Pipeline / Validate Code Quality And Tests (push) Has been cancelled
CI/CD Pipeline / Unit Tests (push) Has been cancelled
CI/CD Pipeline / Integration Tests (push) Has been cancelled
CI/CD Pipeline / Frontend Unit Tests (push) Has been cancelled
CI/CD Pipeline / Build Staging API Image (push) Has been cancelled
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (push) Has been cancelled
CI/CD Pipeline / Staging E2E Tests (push) Has been cancelled
CI/CD Pipeline / Staging API Integration Tests (push) Has been cancelled
CI/CD Pipeline / ACR Image Cleanup (push) Has been cancelled
74 lines
2.6 KiB
Docker
Executable File
74 lines
2.6 KiB
Docker
Executable File
# ============================================================
|
|
# Worker Dockerfile - 分层缓存优化版
|
|
# 优化：基础依赖 + Worker大包预构建为基础镜像，业务构建仅叠加业务依赖
|
|
# 基础镜像：worker-base-builder / worker-base-runtime
|
|
# 预计节省：依赖不变时构建时间从23min降至5min以内
|
|
# ============================================================
|
|
|
|
# ==================== Builder 阶段 ====================
|
|
# 从预构建的builder基础镜像开始，已经包含：
|
|
# - 编译工具 (gcc/g++/python3-dev/binutils)
|
|
# - requirements-base.txt 全部依赖
|
|
# - requirements-worker.txt 全部依赖 (numpy/scipy/opencv)
|
|
# - 预strip的.so文件
|
|
FROM git.xiaoxiajianji.com/xiaoxia-saas/worker-base-builder:latest AS builder
|
|
|
|
ENV PATH="/opt/venv/bin:$PATH"
|
|
|
|
WORKDIR /tmp
|
|
|
|
# ---- 安装业务依赖（变化频繁，单独一层）----
|
|
COPY requirements.txt /tmp/requirements.txt
|
|
RUN --mount=type=cache,target=/root/.cache/pip,sharing=locked \
|
|
pip install --no-cache-dir -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com \
|
|
-r /tmp/requirements.txt \
|
|
&& rm /tmp/requirements.txt
|
|
|
|
# ---- 增量瘦身（只处理新增的业务依赖）----
|
|
RUN find /opt/venv -name "*.so" -type f -exec strip --strip-all {} \; 2>/dev/null || true
|
|
RUN find /opt/venv -type d -name "__pycache__" -exec rm -rf {} + 2>/dev/null; \
|
|
find /opt/venv -name "*.pyc" -delete 2>/dev/null || true
|
|
|
|
# ==================== Runtime 阶段 ====================
|
|
# 从预构建的runtime基础镜像开始，已经包含：
|
|
# - ffmpeg
|
|
# - libglib2.0-0
|
|
FROM git.xiaoxiajianji.com/xiaoxia-saas/worker-base-runtime:latest AS runtime
|
|
|
|
# 构建参数：版本号
|
|
ARG APP_VERSION=dev
|
|
|
|
# 从 builder 复制 Python 虚拟环境
|
|
COPY --from=builder /opt/venv /opt/venv
|
|
|
|
# 设置工作目录
|
|
WORKDIR /app
|
|
|
|
# 复制应用代码
|
|
COPY apps/worker/ /app/apps/worker/
|
|
COPY apps/api/app/config.py /app/apps/api/app/config.py
|
|
COPY apps/api/app/core/ /app/apps/api/app/core/
|
|
COPY packages/ /app/packages/
|
|
COPY alembic.ini /app/alembic.ini
|
|
COPY migrations/ /app/migrations/
|
|
|
|
# 复制 Worker 启动脚本
|
|
COPY infra/docker/entrypoint-worker.sh /usr/local/bin/entrypoint-worker.sh
|
|
RUN chmod +x /usr/local/bin/entrypoint-worker.sh
|
|
|
|
# 设置 Python 路径
|
|
ENV PATH="/opt/venv/bin:$PATH"
|
|
ENV PYTHONPATH=/app:/app/packages
|
|
ENV PYTHONUNBUFFERED=1
|
|
ENV APP_VERSION=$APP_VERSION
|
|
|
|
# 创建非 root 用户运行 Worker
|
|
RUN groupadd -r celery && useradd -r -g celery -d /app -s /sbin/nologin celery \
|
|
&& mkdir -p /app/generated && chown celery:celery /app/generated
|
|
|
|
USER celery
|
|
|
|
# Worker 入口点
|
|
WORKDIR /app/apps/worker
|
|
CMD ["/usr/local/bin/entrypoint-worker.sh"]
|