We just merged the bit py2->py3 conversion pull request to master. Most tests are passing, but lots of stuff is going to break. Please look for problems and send PRs or at least let us know. There's an etherpad with a TODO list here: https://pad.ceph.com/p/py3 If you need to base a branch or whatever on a non-broken py2 base, you the last-py2 branch in ceph.git. Big changes (Alfredo, please correct anything I get wrong here!) - Master (and octopus) are python3 only. Mgr modules are all python 3. The only (known) remaining py2/py3 script in ceph.git (that users will see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on either version. - We're only producing python bindings for rados/rgw/rbd/cephfs for python 3 now. That means no more python-rados; only python3-rados. - Master/octopus are centos8-only. There will be no centos7 server packages for octopus. Likewise, there will be no nautilus or mimic packages for centos8. It is not possible/practical to port our py2 dependencies forward or py3 dependencies backwards. That means: - package-based upgrades will be tested on ubuntu only - centos7 users will need to either simultaneously upgarde distro+ceph or migrate to a containerized ceph (either cephadm or ceph-ansible-deployed containers). - Teuthology is still py2. Any tests that run stuff out of qa/tasks on the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has working versions of both py2 and py3). - ceph-container is switching to a centos8 base. We're dropping ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds are available. - Any other random tests we came across that need py2 (e.g., s3-tests) are pinned to ubuntu test nodes for the time being. Lots of catch-up to do here. Yay! Big thanks to Alfredo, David, Ken, and the rest of the team who have been slaving away building packages for all of our py3 dependencies for fedora and centos8! It was a lot of stuff: https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/ sage
\o/ On Wed, Dec 18, 2019 at 8:01 AM Sage Weil <sweil@redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master. Most tests are passing, but lots of stuff is going to break. Please look for problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
If you need to base a branch or whatever on a non-broken py2 base, you the last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3. The only (known) remaining py2/py3 script in ceph.git (that users will see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server packages for octopus. Likewise, there will be no nautilus or mimic packages for centos8. It is not possible/practical to port our py2 dependencies forward or py3 dependencies backwards. That means:
- package-based upgrades will be tested on ubuntu only - centos7 users will need to either simultaneously upgarde distro+ceph or migrate to a containerized ceph (either cephadm or ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds are available.
- Any other random tests we came across that need py2 (e.g., s3-tests) are pinned to ubuntu test nodes for the time being. Lots of catch-up to do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been slaving away building packages for all of our py3 dependencies for fedora and centos8! It was a lot of stuff:
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
-- Cheers, Brad
Thanks Sage! It seemed borderline impossible to get here without the last push with core changes On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil@redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master. Most tests are passing, but lots of stuff is going to break. Please look for problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
If you need to base a branch or whatever on a non-broken py2 base, you the last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3. The only (known) remaining py2/py3 script in ceph.git (that users will see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server packages for octopus. Likewise, there will be no nautilus or mimic packages for centos8. It is not possible/practical to port our py2 dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the dependencies needed for Python3. It is just not possible.
- package-based upgrades will be tested on ubuntu only - centos7 users will need to either simultaneously upgarde distro+ceph or migrate to a containerized ceph (either cephadm or ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds are available.
- Any other random tests we came across that need py2 (e.g., s3-tests) are pinned to ubuntu test nodes for the time being. Lots of catch-up to do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been slaving away building packages for all of our py3 dependencies for fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for half of those packages!
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
Another point to raise here is that Python3 dependencies that have been made available for CentOS8 are impossible to meet for CentOS7. There are a few reasons for this, but it is primarily because the dependency requirements on many packages cannot be met in CentOS7. For example, the `pytest` package on CentOS7 is at version 2.7 and it comes from the base repository. Other Python packages require pytest, but for Python3 they require a newer version of pytest that supports it. One of the packaging rules in CentOS (and EPEL) is that we can't "bump" the version of a package that is already provided in base. This is just one example, but if we can't bump pytest, we can't even try to package the many other packages that depend on it that are needed for Ceph. In the case of CentOS8 we had to modify some packages like CherryPy that was using the latest pytest available with incompatible features for the one that is provided by CentOS8! To recap: it is not possible to get all the dependencies built for Ceph for CentOS8 (like the Python3 ones) on CentOS7 because dependencies cannot be met. On Wed, Dec 18, 2019 at 7:44 AM Alfredo Deza <adeza@redhat.com> wrote:
Thanks Sage! It seemed borderline impossible to get here without the last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil@redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master. Most tests are passing, but lots of stuff is going to break. Please look for problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
If you need to base a branch or whatever on a non-broken py2 base, you the last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3. The only (known) remaining py2/py3 script in ceph.git (that users will see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server packages for octopus. Likewise, there will be no nautilus or mimic packages for centos8. It is not possible/practical to port our py2 dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the dependencies needed for Python3. It is just not possible.
- package-based upgrades will be tested on ubuntu only - centos7 users will need to either simultaneously upgarde distro+ceph or migrate to a containerized ceph (either cephadm or ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds are available.
- Any other random tests we came across that need py2 (e.g., s3-tests) are pinned to ubuntu test nodes for the time being. Lots of catch-up to do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been slaving away building packages for all of our py3 dependencies for fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for half of those packages!
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
Will the container image distros only limited to centos 8 based because of that? Can ubuntu be reintroduced? On Wed, Dec 18, 2019, 7:42 AM Alfredo Deza <adeza@redhat.com> wrote:
Another point to raise here is that Python3 dependencies that have been made available for CentOS8 are impossible to meet for CentOS7.
There are a few reasons for this, but it is primarily because the dependency requirements on many packages cannot be met in CentOS7. For example, the `pytest` package on CentOS7 is at version 2.7 and it comes from the base repository. Other Python packages require pytest, but for Python3 they require a newer version of pytest that supports it.
One of the packaging rules in CentOS (and EPEL) is that we can't "bump" the version of a package that is already provided in base. This is just one example, but if we can't bump pytest, we can't even try to package the many other packages that depend on it that are needed for Ceph.
In the case of CentOS8 we had to modify some packages like CherryPy that was using the latest pytest available with incompatible features for the one that is provided by CentOS8!
To recap: it is not possible to get all the dependencies built for Ceph for CentOS8 (like the Python3 ones) on CentOS7 because dependencies cannot be met.
On Wed, Dec 18, 2019 at 7:44 AM Alfredo Deza <adeza@redhat.com> wrote:
Thanks Sage! It seemed borderline impossible to get here without the last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil@redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master.
tests are passing, but lots of stuff is going to break. Please look for problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
If you need to base a branch or whatever on a non-broken py2 base, you
Most the
last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3. The only (known) remaining py2/py3 script in ceph.git (that users will see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server packages for octopus. Likewise, there will be no nautilus or mimic packages for centos8. It is not possible/practical to port our py2 dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the dependencies needed for Python3. It is just not possible.
- package-based upgrades will be tested on ubuntu only - centos7 users will need to either simultaneously upgarde
distro+ceph
or migrate to a containerized ceph (either cephadm or ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds are available.
- Any other random tests we came across that need py2 (e.g., s3-tests) are pinned to ubuntu test nodes for the time being. Lots of catch-up to do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been slaving away building packages for all of our py3 dependencies for fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for half of those packages!
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
On Sat, 21 Dec 2019, Sasha Litvak wrote:
Will the container image distros only limited to centos 8 based because of that? Can ubuntu be reintroduced?
The point of the container is that we only need one image that can be used on any distro. One place to track down dependencies, one set of runtime libraries to test, etc. We're currently using centos8. ceph-container can be adapted to build containers based on other distros, if there is a case to be made to switch to something else, and all of the dependencies are available. cephadm is the new orchestration tool that deploys ceph daemons in containers on any host OS that has python and either podman or docker. Unless you go out of your way to look, you won't even know what distro the image is based on. sage
On Wed, Dec 18, 2019, 7:42 AM Alfredo Deza <adeza@redhat.com> wrote:
Another point to raise here is that Python3 dependencies that have been made available for CentOS8 are impossible to meet for CentOS7.
There are a few reasons for this, but it is primarily because the dependency requirements on many packages cannot be met in CentOS7. For example, the `pytest` package on CentOS7 is at version 2.7 and it comes from the base repository. Other Python packages require pytest, but for Python3 they require a newer version of pytest that supports it.
One of the packaging rules in CentOS (and EPEL) is that we can't "bump" the version of a package that is already provided in base. This is just one example, but if we can't bump pytest, we can't even try to package the many other packages that depend on it that are needed for Ceph.
In the case of CentOS8 we had to modify some packages like CherryPy that was using the latest pytest available with incompatible features for the one that is provided by CentOS8!
To recap: it is not possible to get all the dependencies built for Ceph for CentOS8 (like the Python3 ones) on CentOS7 because dependencies cannot be met.
On Wed, Dec 18, 2019 at 7:44 AM Alfredo Deza <adeza@redhat.com> wrote:
Thanks Sage! It seemed borderline impossible to get here without the last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil@redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master.
tests are passing, but lots of stuff is going to break. Please look for problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
If you need to base a branch or whatever on a non-broken py2 base, you
Most the
last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3. The only (known) remaining py2/py3 script in ceph.git (that users will see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server packages for octopus. Likewise, there will be no nautilus or mimic packages for centos8. It is not possible/practical to port our py2 dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the dependencies needed for Python3. It is just not possible.
- package-based upgrades will be tested on ubuntu only - centos7 users will need to either simultaneously upgarde
distro+ceph
or migrate to a containerized ceph (either cephadm or ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds are available.
- Any other random tests we came across that need py2 (e.g., s3-tests) are pinned to ubuntu test nodes for the time being. Lots of catch-up to do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been slaving away building packages for all of our py3 dependencies for fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for half of those packages!
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage _______________________________________________ Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
Dev mailing list -- dev@ceph.io To unsubscribe send an email to dev-leave@ceph.io
On Sat, 21 Dec 2019, Sasha Litvak wrote:
Will the container image distros only limited to centos 8 based because of that? Can ubuntu be reintroduced?
The point of the container is that we only need one image that can be used on any distro. One place to track down dependencies, one set of runtime libraries to test, etc.
We're currently using centos8. ceph-container can be adapted to build containers based on other distros, if there is a case to be made to switch to something else, and all of the dependencies are available.
cephadm is the new orchestration tool that deploys ceph daemons in containers on any host OS that has python and either podman or docker. Unless you go out of your way to look, you won't even know what distro the image is based on.
sage
Will containerization hamper logs and debugging? I’ve found docker to be a royal PITA in these respects.
On Sat, 21 Dec 2019, Anthony D'Atri wrote:
On Sat, 21 Dec 2019, Sasha Litvak wrote:
Will the container image distros only limited to centos 8 based because of that? Can ubuntu be reintroduced?
The point of the container is that we only need one image that can be used on any distro. One place to track down dependencies, one set of runtime libraries to test, etc.
We're currently using centos8. ceph-container can be adapted to build containers based on other distros, if there is a case to be made to switch to something else, and all of the dependencies are available.
cephadm is the new orchestration tool that deploys ceph daemons in containers on any host OS that has python and either podman or docker. Unless you go out of your way to look, you won't even know what distro the image is based on.
sage
Will containerization hamper logs and debugging? I’ve found docker to be a royal PITA in these respects.
I agree--especially for someone somewhat unfamiliar with containers. cephadm sets up binds mounts and log rotation for the host /var/log/ceph into the container, but by default logging is done the containery way by just writing to stderr where it is picked up by journald. You can switch to traditional log files with 'ceph config set global log_to_file true'. sage
participants (5)
-
Alfredo Deza
-
Anthony D'Atri
-
Brad Hubbard
-
Sage Weil
-
Sasha Litvak