17 Dec
2019
17 Dec
'19
10 p.m.
We just merged the bit py2->py3 conversion pull request to master. Most
tests are passing, but lots of stuff is going to break. Please look for
problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
https://pad.ceph.com/p/py3
If you need to base a branch or whatever on a non-broken py2 base, you the
last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3.
The only (known) remaining py2/py3 script in ceph.git (that users will
see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on
either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for
python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server
packages for octopus. Likewise, there will be no nautilus or mimic
packages for centos8. It is not possible/practical to port our py2
dependencies forward or py3 dependencies backwards. That means:
- package-based upgrades will be tested on ubuntu only
- centos7 users will need to either simultaneously upgarde distro+ceph
or migrate to a containerized ceph (either cephadm or
ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on
the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has
working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping
ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds
are available.
- Any other random tests we came across that need py2 (e.g., s3-tests)
are pinned to ubuntu test nodes for the time being. Lots of catch-up to
do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been
slaving away building packages for all of our py3 dependencies for
fedora and centos8! It was a lot of stuff:
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage
17 Dec
17 Dec
11:46 p.m.
\o/
On Wed, Dec 18, 2019 at 8:01 AM Sage Weil <sweil(a)redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master. Most
tests are passing, but lots of stuff is going to break. Please look for
problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
https://pad.ceph.com/p/py3
If you need to base a branch or whatever on a non-broken py2 base, you the
last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3.
The only (known) remaining py2/py3 script in ceph.git (that users will
see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on
either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for
python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server
packages for octopus. Likewise, there will be no nautilus or mimic
packages for centos8. It is not possible/practical to port our py2
dependencies forward or py3 dependencies backwards. That means:
- package-based upgrades will be tested on ubuntu only
- centos7 users will need to either simultaneously upgarde distro+ceph
or migrate to a containerized ceph (either cephadm or
ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on
the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has
working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping
ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds
are available.
- Any other random tests we came across that need py2 (e.g., s3-tests)
are pinned to ubuntu test nodes for the time being. Lots of catch-up to
do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been
slaving away building packages for all of our py3 dependencies for
fedora and centos8! It was a lot of stuff:
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage
_______________________________________________
Dev mailing list -- dev(a)ceph.io
To unsubscribe send an email to dev-leave(a)ceph.io
--
Cheers,
Brad
18 Dec
18 Dec
12:44 p.m.
Thanks Sage! It seemed borderline impossible to get here without the
last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil(a)redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master. Most
tests are passing, but lots of stuff is going to break. Please look for
problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
https://pad.ceph.com/p/py3
If you need to base a branch or whatever on a non-broken py2 base, you the
last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3.
The only (known) remaining py2/py3 script in ceph.git (that users will
see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on
either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for
python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server
packages for octopus. Likewise, there will be no nautilus or mimic
packages for centos8. It is not possible/practical to port our py2
dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the
dependencies needed for Python3. It is just not possible.
- package-based upgrades will be tested on ubuntu only
- centos7 users will need to either simultaneously upgarde distro+ceph
or migrate to a containerized ceph (either cephadm or
ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on
the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has
working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping
ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds
are available.
- Any other random tests we came across that need py2 (e.g., s3-tests)
are pinned to ubuntu test nodes for the time being. Lots of catch-up to
do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been
slaving away building packages for all of our py3 dependencies for
fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for
half of those packages!
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
sage
_______________________________________________
Dev mailing list -- dev(a)ceph.io
To unsubscribe send an email to dev-leave(a)ceph.io
1:42 p.m.
Another point to raise here is that Python3 dependencies that have
been made available for CentOS8 are impossible to meet for CentOS7.
There are a few reasons for this, but it is primarily because the
dependency requirements on many packages cannot be met in CentOS7. For
example, the
`pytest` package on CentOS7 is at version 2.7 and it comes from the
base repository. Other Python packages require pytest, but for Python3
they require a newer
version of pytest that supports it.
One of the packaging rules in CentOS (and EPEL) is that we can't
"bump" the version of a package that is already provided in base. This
is just one example, but if we can't
bump pytest, we can't even try to package the many other packages that
depend on it that are needed for Ceph.
In the case of CentOS8 we had to modify some packages like CherryPy
that was using the latest pytest available with incompatible features
for the one that is provided by CentOS8!
To recap: it is not possible to get all the dependencies built for
Ceph for CentOS8 (like the Python3 ones) on CentOS7 because
dependencies cannot be met.
On Wed, Dec 18, 2019 at 7:44 AM Alfredo Deza <adeza(a)redhat.com> wrote:
Thanks Sage! It seemed borderline impossible to get here without the
last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil(a)redhat.com> wrote:
We just merged the bit py2->py3 conversion pull request to master. Most
tests are passing, but lots of stuff is going to break. Please look for
problems and send PRs or at least let us know.
There's an etherpad with a TODO list here:
https://pad.ceph.com/p/py3
If you need to base a branch or whatever on a non-broken py2 base, you the
last-py2 branch in ceph.git.
Big changes (Alfredo, please correct anything I get wrong here!)
- Master (and octopus) are python3 only. Mgr modules are all python 3.
The only (known) remaining py2/py3 script in ceph.git (that users will
see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run on
either version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for
python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server
packages for octopus. Likewise, there will be no nautilus or mimic
packages for centos8. It is not possible/practical to port our py2
dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the
dependencies needed for Python3. It is just not possible.
- package-based upgrades will be tested on ubuntu only
- centos7 users will need to either simultaneously upgarde distro+ceph
or migrate to a containerized ceph (either cephadm or
ceph-ansible-deployed containers).
- Teuthology is still py2. Any tests that run stuff out of qa/tasks on
the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has
working versions of both py2 and py3).
- ceph-container is switching to a centos8 base. We're dropping
ceph-iscsi and nfs-ganesha from the (master/wip) images until those builds
are available.
- Any other random tests we came across that need py2 (e.g., s3-tests)
are pinned to ubuntu test nodes for the time being. Lots of catch-up to
do here.
Yay!
Big thanks to Alfredo, David, Ken, and the rest of the team who have been
slaving away building packages for all of our py3 dependencies for
fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for
half of those packages!
>
> https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
>
> sage
> _______________________________________________
> Dev mailing list -- dev(a)ceph.io
> To unsubscribe send an email to dev-leave(a)ceph.io
> 
21 Dec
21 Dec
4:27 p.m.
Will the container image distros only limited to centos 8 based because of
that? Can ubuntu be reintroduced?
On Wed, Dec 18, 2019, 7:42 AM Alfredo Deza <adeza(a)redhat.com> wrote:
Another point to raise here is that Python3
dependencies that have
been made available for CentOS8 are impossible to meet for CentOS7.
There are a few reasons for this, but it is primarily because the
dependency requirements on many packages cannot be met in CentOS7. For
example, the
`pytest` package on CentOS7 is at version 2.7 and it comes from the
base repository. Other Python packages require pytest, but for Python3
they require a newer
version of pytest that supports it.
One of the packaging rules in CentOS (and EPEL) is that we can't
"bump" the version of a package that is already provided in base. This
is just one example, but if we can't
bump pytest, we can't even try to package the many other packages that
depend on it that are needed for Ceph.
In the case of CentOS8 we had to modify some packages like CherryPy
that was using the latest pytest available with incompatible features
for the one that is provided by CentOS8!
To recap: it is not possible to get all the dependencies built for
Ceph for CentOS8 (like the Python3 ones) on CentOS7 because
dependencies cannot be met.
On Wed, Dec 18, 2019 at 7:44 AM Alfredo Deza <adeza(a)redhat.com> wrote:
distro+ceph
_______________________________________________
Dev mailing list -- dev(a)ceph.io
To unsubscribe send an email to dev-leave(a)ceph.io
Thanks Sage! It seemed borderline impossible to get here without the
last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil(a)redhat.com> wrote:
>
> We just merged the bit py2->py3 conversion pull request to master.
Most
> tests are passing, but lots of stuff is
going to break. Please look
for
> problems and send PRs or at least let us
know.
>
> There's an etherpad with a TODO list here:
>
> https://pad.ceph.com/p/py3
>
> If you need to base a branch or whatever on a non-broken py2 base, you
the
> last-py2 branch in ceph.git.
>
>
> Big changes (Alfredo, please correct anything I get wrong here!)
>
> - Master (and octopus) are python3 only. Mgr modules are all python 3.
> The only (known) remaining py2/py3 script in ceph.git (that users will
> see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run
on
either
version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for
python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server
packages for octopus. Likewise, there will be no nautilus or mimic
packages for centos8. It is not possible/practical to port our py2
dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the
dependencies needed for Python3. It is just not possible.
>
> - package-based upgrades will be tested on ubuntu only
> - centos7 users will need to either simultaneously upgarde > or migrate to a containerized ceph (either
cephadm or
> ceph-ansible-deployed containers).
>
> - Teuthology is still py2. Any tests that run stuff out of qa/tasks on
> the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has
> working versions of both py2 and py3).
>
> - ceph-container is switching to a centos8 base. We're dropping
> ceph-iscsi and nfs-ganesha from the (master/wip) images until those
builds
> are available.
>
> - Any other random tests we came across that need py2 (e.g., s3-tests)
> are pinned to ubuntu test nodes for the time being. Lots of catch-up
to
> do here.
>
> Yay!
>
> Big thanks to Alfredo, David, Ken, and the rest of the team who have
been
slaving
away building packages for all of our py3 dependencies for
fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for
half of those packages!
>
> https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
>
> sage
> _______________________________________________
> Dev mailing list -- dev(a)ceph.io
> To unsubscribe send an email to dev-leave(a)ceph.io
>
5:59 p.m.
On Sat, 21 Dec 2019, Sasha Litvak wrote:
Will the container image distros only limited to
centos 8 based because of
that? Can ubuntu be reintroduced?
The point of the container is that we only need one image that can be used
on any distro. One place to track down dependencies, one set of runtime
libraries to test, etc.
We're currently using centos8. ceph-container can be adapted to build
containers based on other distros, if there is a case to be made to switch
to something else, and all of the dependencies are available.
cephadm is the new orchestration tool that deploys ceph daemons in
containers on any host OS that has python and either podman or docker.
Unless you go out of your way to look, you won't even know what distro the
image is based on.
sage
On Wed, Dec 18, 2019, 7:42 AM Alfredo Deza <adeza(a)redhat.com> wrote:
Another point to raise here is that Python3
dependencies that have
been made available for CentOS8 are impossible to meet for CentOS7.
There are a few reasons for this, but it is primarily because the
dependency requirements on many packages cannot be met in CentOS7. For
example, the
`pytest` package on CentOS7 is at version 2.7 and it comes from the
base repository. Other Python packages require pytest, but for Python3
they require a newer
version of pytest that supports it.
One of the packaging rules in CentOS (and EPEL) is that we can't
"bump" the version of a package that is already provided in base. This
is just one example, but if we can't
bump pytest, we can't even try to package the many other packages that
depend on it that are needed for Ceph.
In the case of CentOS8 we had to modify some packages like CherryPy
that was using the latest pytest available with incompatible features
for the one that is provided by CentOS8!
To recap: it is not possible to get all the dependencies built for
Ceph for CentOS8 (like the Python3 ones) on CentOS7 because
dependencies cannot be met.
On Wed, Dec 18, 2019 at 7:44 AM Alfredo Deza <adeza(a)redhat.com> wrote:
distro+ceph
_______________________________________________
Dev mailing list -- dev(a)ceph.io
To unsubscribe send an email to dev-leave(a)ceph.io
Thanks Sage! It seemed borderline impossible to get here without the
last push with core changes
On Tue, Dec 17, 2019 at 5:01 PM Sage Weil <sweil(a)redhat.com> wrote:
>
> We just merged the bit py2->py3 conversion pull request to master.
Most
> tests are passing, but lots of stuff is
going to break. Please look
for
> problems and send PRs or at least let us
know.
>
> There's an etherpad with a TODO list here:
>
> https://pad.ceph.com/p/py3
>
> If you need to base a branch or whatever on a non-broken py2 base, you
the
> last-py2 branch in ceph.git.
>
>
> Big changes (Alfredo, please correct anything I get wrong here!)
>
> - Master (and octopus) are python3 only. Mgr modules are all python 3.
> The only (known) remaining py2/py3 script in ceph.git (that users will
> see) is /usr/bin/cephadm, which is designed to be 2/3 agnostic and run
on
either
version.
- We're only producing python bindings for rados/rgw/rbd/cephfs for
python 3 now. That means no more python-rados; only python3-rados.
- Master/octopus are centos8-only. There will be no centos7 server
packages for octopus. Likewise, there will be no nautilus or mimic
packages for centos8. It is not possible/practical to port our py2
dependencies forward or py3 dependencies backwards. That means:
I want to add emphasis in that Centos7 will *never* have the
dependencies needed for Python3. It is just not possible.
>
> - package-based upgrades will be tested on ubuntu only
> - centos7 users will need to either simultaneously upgarde > or migrate to a containerized ceph (either
cephadm or
> ceph-ansible-deployed containers).
>
> - Teuthology is still py2. Any tests that run stuff out of qa/tasks on
> the host (e.g., vstart-runner) need to run on ubuntu 18.04 (which has
> working versions of both py2 and py3).
>
> - ceph-container is switching to a centos8 base. We're dropping
> ceph-iscsi and nfs-ganesha from the (master/wip) images until those
builds
> are available.
>
> - Any other random tests we came across that need py2 (e.g., s3-tests)
> are pinned to ubuntu test nodes for the time being. Lots of catch-up
to
> do here.
>
> Yay!
>
> Big thanks to Alfredo, David, Ken, and the rest of the team who have
been
slaving
away building packages for all of our py3 dependencies for
fedora and centos8! It was a lot of stuff:
Also Kefu, and Justin Caratzas, who signed up to be co-maintainer for
half of those packages!
>
> https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/packages/
>
> sage
> _______________________________________________
> Dev mailing list -- dev(a)ceph.io
> To unsubscribe send an email to dev-leave(a)ceph.io
> 
8:34 p.m.
On Sat, 21 Dec 2019, Sasha Litvak wrote:
Will containerization hamper logs and debugging? I’ve found docker to be a royal PITA in
these respects.
Will the container image distros only limited to
centos 8 based because of
that? Can ubuntu be reintroduced?
The point of the container is that we only need one image that can be used
on any distro. One place to track down dependencies, one set of runtime
libraries to test, etc.
We're currently using centos8. ceph-container can be adapted to build
containers based on other distros, if there is a case to be made to switch
to something else, and all of the dependencies are available.
cephadm is the new orchestration tool that deploys ceph daemons in
containers on any host OS that has python and either podman or docker.
Unless you go out of your way to look, you won't even know what distro the
image is based on.
sage
10:51 p.m.
On Sat, 21 Dec 2019, Anthony D'Atri wrote:
I agree--especially for someone somewhat unfamiliar with containers.
cephadm sets up binds mounts and log rotation for the host /var/log/ceph
into the container, but by default logging is done the containery way by
just writing to stderr where it is picked up by journald. You can switch
to traditional log files with 'ceph config set global log_to_file true'.
sage
On Sat, 21
Dec 2019, Sasha Litvak wrote:
Will containerization hamper logs and debugging? I’ve found docker to
be a royal PITA in these respects. Will the container image distros only limited to
centos 8 based because of
that? Can ubuntu be reintroduced?
The point of the container is that we only need one image that can be used
on any distro. One place to track down dependencies, one set of runtime
libraries to test, etc.
We're currently using centos8. ceph-container can be adapted to build
containers based on other distros, if there is a case to be made to switch
to something else, and all of the dependencies are available.
cephadm is the new orchestration tool that deploys ceph daemons in
containers on any host OS that has python and either podman or docker.
Unless you go out of your way to look, you won't even know what distro the
image is based on.
sage
1587
days inactive
1591
days old
7 comments
5 participants
participants (5)
-
Alfredo Deza -
Anthony D'Atri -
Brad Hubbard -
Sage Weil -
Sasha Litvak