Greetings,
I’m deploying model objective via docker images. Dockerfile is like this
FROM <MODEL_BASE_IMG>
USER root
WORKDIR /models
RUN getent group 1000 ...
COPY /folder/model_checkpoint /models/checkpoint
RUN chown -R 1000:1000 /models
USER 1000
EXPOSE 8080
ENTRYPOINT [...]
CMD ["/models/checkpoint", \
"--host", "0.0.0.0", \
"--port", "8080", \
]
Each time I update the model with new model_checkpoint file, I have to build the image again while there’s no change in the environment set up. It’s quite time-wasting when the model_checkpoint file is GBs large.
Is there any way I separate the model_checkpoint file and the Docker image?
Like storing model_checkpoint file in some dataset, and when doing the docker run, it gets the latest model_checkpoint file from that dataset to run, then I don’t have to build the image again.
Thanks in advance.