Declarative Pipeline: package update not installed on serverless cluster
Reddit r/databricks4w4 min read
I am working with an automation bundle in which I have included a python package as well as a declarative pipeline that uses a function from that package. I have configured the bundle in such a way so that it first builds the wheel and then proceeds with the deployment. when i deploy the bundle via \`databricks bundle deploy -t dev\` and then run the pipeline everything works as expected. However when i do make updates in the python package and redeploy the serverless cluster does not seem to install the new version of the wheel file. This happens also when i update the version of the package.
