crunchy-containers icon indicating copy to clipboard operation
crunchy-containers copied to clipboard

PgBackRest 2.38 missing for CentOS builds

Open tolleiv opened this issue 3 years ago • 3 comments

Merge #1428 raised the PgBackRest version to 2.38, but this isn't available on the Yum Repositories, therefore building the most recent version 5.1.x won't succeed with centos based containers.

To Reproduce

export IMGBUILDER=docker
export CCP_BASEOS=centos8
export CCP_PGVERSION=14
export CCP_VERSION="5.1.1-0"

cd $CCPROOT
curl https://api.developers.crunchydata.com/downloads/repo/rpm-centos/postgresql14/crunchypg14.repo > conf/crunchypg14.repo

curl https://api.developers.crunchydata.com/downloads/gpg/RPM-GPG-KEY-crunchydata-dev > conf/RPM-GPG-KEY-crunchydata-dev

cd $CCPROOT
make setup

make setup
make postgres

will break with:

Error: Unable to find a match: crunchy-backrest-2.38

Expected behavior The builds should run successfully.

Please tell us about your environment:

  • Operating System:
  • Where is this running: Local
  • Storage being used: not relevant
  • Container Image Tag: not relevant
  • PostgreSQL Version: 14, 13
  • Platform (Docker, Kubernetes, OpenShift): not relevant
  • Platform Version: 5.1.1

Additional context

Using export CCP_BACKREST_VERSION=2.36 for the build will use the "old" pg_backrest version and builds will succeed, but version 2.38 is not available on any of the Yum repositories would be great if you could provide it.

tolleiv avatar May 23 '22 10:05 tolleiv

I also met this issue: No package matches 'crunchy-backrest-2.38' 11:35:12 (microdnf:13): librepo-WARNING **: 03:35:11.839: WARNING: Repomd xml parser: Unknown element "revision" 11:35:15 error: No package matches 'crunchy-backrest-2.38' 11:35:20 error building at STEP "RUN if [ "$DFSET" = "centos" ] ; then ${PACKAGER} -y install --nodocs openssh-clients openssh-server pgaudit${PG_MAJOR//.} pgaudit${PG_MAJOR//.}_set_user pg_partman_${PG_MAJOR//.} pg_cron_${PG_MAJOR//.} crunchy-backrest-${BACKREST_VER} postgresql${PG_MAJOR//.}-contrib postgresql${PG_MAJOR//.}-server postgresql${PG_MAJOR//.}-plpython* pgnodemx${PG_MAJOR//.} $( printf '11\n'${PG_MAJOR} | sort -VC && echo postgresql${PG_MAJOR}-llvmjit ) psmisc python3-pip python3-psutil python3-psycopg2 rsync $( printf '11\n'${PG_MAJOR} | sort -VC && echo timescaledb_${PG_MAJOR} ) wal2json_${PG_MAJOR//.} file gettext hostname procps-ng pgaudit_analyze unzip bzip2 lz4 krb5-workstation && ${PACKAGER} -y clean all ; else ${PACKAGER} -y install --nodocs --enablerepo="epel" openssh-clients openssh-server pgaudit${PG_MAJOR//.} pgaudit${PG_MAJOR//.}_set_user pg_partman_${PG_MAJOR//.} pg_cron_${PG_MAJOR//.} crunchy-backrest-${BACKREST_VER} postgresql${PG_MAJOR//.}-contrib postgresql${PG_MAJOR//.}-server postgresql${PG_MAJOR//.}-plpython* pgnodemx${PG_MAJOR//.} $( printf '11\n'${PG_MAJOR} | sort -VC && echo postgresql${PG_MAJOR}-llvmjit ) psmisc python3-pip python3-psutil python3-psycopg2 rsync $( printf '11\n'${PG_MAJOR} | sort -VC && echo timescaledb_${PG_MAJOR} ) wal2json_${PG_MAJOR//.} file unzip tar bzip2 lz4 krb5-workstation && ${PACKAGER} -y install --nodocs --setopt=tsflags='' --enablerepo="epel" pgaudit_analyze && ${PACKAGER} -y clean all --enablerepo="epel" ; fi": error while running runtime: exit status 1 11:35:20 make[1]: *** [Makefile:147: postgres-pgimg-build] Error 1 11:35:20 make[1]: Leaving directory '/go/src/github.com/CrunchyData/crunchy-containers' 11:35:20 make: *** [Makefile:22: build_image] Error 1 [Pipeline] }

olivejing avatar May 27 '22 03:05 olivejing

And CCP_PG_FULLVERSION ?= 13.7 is not support now. in repo https://repo.developers.crunchydata.com/postgresql13/centos/EL8/, no rpm for pg 13.7.

olivejing avatar May 27 '22 06:05 olivejing

you should check this out https://github.com/CrunchyData/crunchy-containers/pull/1475

it's a replacement for centos8 with official postgres repo attached

hint: you can also rename crunchy-backrest package installation to just pgbackrest and it will install from postgres repo https://download.postgresql.org/pub/repos/yum/common/redhat/rhel-8-x86_64/ cmd+f pgbackrest

pere3 avatar Sep 05 '22 14:09 pere3