ylqjgm
/
canvas-lms
mirror of https://github.com/instructure/canvas-lms.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
canvas-lms/Dockerfile.jenkins

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

63 lines
2.2 KiB
Docker
Raw Normal View History

split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
# GENERATED FILE, DO NOT MODIFY!
# To update this file please edit the relevant template and run the generation
minimize file dependencies for bundle caching refs DE-187 [change-merged] [build-registry-path=jenkins/canvas-lms-de-187-test] Test Plan: Ensure that the cache is used for bundle install when a gem changes and the build is run on a different node. Change-Id: I43f83338a25a0774030495904b75d0825abcc5bb Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/244748 QA-Review: Aaron Ogata <aogata@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-11 22:53:05 +08:00
# task `build/dockerfile_writer.rb --env jenkins --compose-file docker-compose.yml,docker-compose.override.yml --in build/Dockerfile.template --out Dockerfile.jenkins`
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
upgrade ruby version in Dockerfiles with the recent upgrade of the ruby version in our Jenkins build we need to make our Dockerfiles match that version 2.7 [canvas-builds-refspec=2427eaa818279a3b95f5ae0169d4896ba0cb5f7d] flag = none Test Plan: -Jenkins passes -local docker dev setup still works, no regressions Change-Id: I4a87aa401df1c8c58b733990aba619aeed2e6347 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/268900 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: James Butters <jbutters@instructure.com> Product-Review: James Butters <jbutters@instructure.com> Reviewed-by: Kyle Rosenbaum <krosenbaum@instructure.com>
2021-07-13 21:34:50 +08:00
ARG RUBY=2.7
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
introduce docker image sync job refs DE-368 When the images are rebuilt, it changes the image digest causing the cache to become invalid. It can also break the build and is not easily revertable to the previous image. Work around this issue by mirroring the dockerhub image on starlord, and update it via a cron job. Change-Id: I2f3f80ea53c7c306a126805b429781743df85aa6 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/256167 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: Kyle Rosenbaum <krosenbaum@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2021-01-07 00:19:06 +08:00
FROM starlord.inscloudgate.net/jenkins/ruby-passenger:$RUBY
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
LABEL maintainer="Instructure"
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
ARG POSTGRES_CLIENT=12
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
ENV APP_HOME /usr/src/app/
ENV RAILS_ENV production
rework handlebars dependency on brandable_css refs FOO-1116 right now in order to build the javascript, we must run brandable_css first for the specific purpose of injecting into handlebars templates their corresponding stylesheet file with the checksum as reported by brandable_css this patch moves things around such that Rails provides this mapping of "handlebars template" to "CSS variant file checksums" in a global variable (Rails is privy to this information already), webpack then at build time injects only a reference to that mapping into the template, then our runtime brandable-css JS helper will resolve that reference from the mapping and request the correct file based on the current user's variant [1] rails assigns window.BRANDABLE_CSS_HANDLEBARS_INDEX with content like this: [ [ "new_styles_normal_contrast", "new_styles_high_contrast", ... ], { "0c": ["0f4f01ab86", 0, 0, "e3e7211701", 3, ... ], ... } ] the structure of the mapping is explained in brandable_css[1], it is a bit overtuned to reduce the size as much as possible since this is included for ALL pages even though the templates in question may never be rendered (right now it's ~1.5kB and should never grow) [2] webpack asks @canvas/brandable-css to loadStylesheetForJST using the contrived id for that file (frontend_build/i18nLinerHandlebars.js:92) [3] brandable-css/index.js will decode that structure to arrive at the exact URL for the stylesheet for that template for the current user variant with this , we should be able to optimize "rake canvas:compile_assets" to run both brandable_css and webpack in parallel, which will greatly mitigate the performance decrease from moving from node-sass to dart-sass == test plan go to some assignment's syllabus page, edit the file app/stylesheets/jst/courses/Syllabus.scss with something fun like: #syllabus .day_date { background: $fire; } rerun `npx brandable_css`, reload the page and verify it's on fire, optionally change your setting to enable High Contrast mode, reload the syllabus page and verify the color changes (it picks up the other variant stylesheet) [1]: https://github.com/instructure/brandable_css/pull/4/commits/80af6e70af6ad60312187f256c2457d33ca75202 Change-Id: Ie48cc71d4837ee02313b2d45a9ad2944725acad2 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/268615 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: August Thornton <august@instructure.com> QA-Review: August Thornton <august@instructure.com> Product-Review: August Thornton <august@instructure.com>
2021-07-08 08:03:09 +08:00
ENV SASS_STYLE compressed
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
ENV NGINX_MAX_UPLOAD_SIZE 10g
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
ENV LANG en_US.UTF-8
ENV LANGUAGE en_US.UTF-8
ENV LC_CTYPE en_US.UTF-8
ENV LC_ALL en_US.UTF-8
enable Rails 6.1 for Jenkins / Dev Change-Id: I321560311670cd22ef356395f755ce39c99fd7ab Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/292200 Reviewed-by: Jacob Burroughs <jburroughs@instructure.com> Reviewed-by: Andrea Cirulli <andrea.cirulli@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2022-05-19 22:54:09 +08:00
ARG CANVAS_RAILS=6.1
replace CANVAS_RAILS6_x variables with CANVAS_RAILS refs DE-523 Test Plan 1. Ensure CANVAS_RAILS override works 2. Ensure file override works 3. Ensure consul override works Change-Id: I6eea63bba5c401428c02179a3d6187c8265ce33e Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/287849 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Jacob Burroughs <jburroughs@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2022-03-24 04:16:20 +08:00
ENV CANVAS_RAILS=${CANVAS_RAILS}
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
ENV YARN_VERSION 1.19.1-1
REQUIRE bundler 2.2.17 https: //nvd.nist.gov/vuln/detail/CVE-2020-36327 Change-Id: I0c43a92ed5c89a475794e1f73b00c528cf261750 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/265630 Reviewed-by: Rob Orton <rob@instructure.com> QA-Review: Cody Cutrer <cody@instructure.com> Product-Review: Cody Cutrer <cody@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
2021-05-25 05:44:17 +08:00
ENV BUNDLER_VERSION 2.2.17
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
ENV GEM_HOME /home/docker/.gem/$RUBY
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
ENV PATH $GEM_HOME/bin:$PATH
ENV BUNDLE_APP_CONFIG /home/docker/.bundle
don’t rebuild packages if only gems change Change-Id: I9fcd27354796acbd0a203dbf6ec0b9fbae913bf2 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/249637 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: James Butters <jbutters@instructure.com> Reviewed-by: Andrea Cirulli <andrea.cirulli@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-10-09 02:50:27 +08:00
WORKDIR $APP_HOME
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
USER root
upgrade node from 14.x to 16.x refs DE-1264 Change-Id: If8b9d73a487b1914b19070a2249394e5116eb8d3 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/295892 Reviewed-by: Charley Kline <ckline@instructure.com> Product-Review: Charley Kline <ckline@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com>
2022-07-12 01:47:27 +08:00
RUN curl -sL https://deb.nodesource.com/setup_16.x | bash - \
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
&& curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add - \
&& echo "deb https://dl.yarnpkg.com/debian/ stable main" > /etc/apt/sources.list.d/yarn.list \
&& printf 'path-exclude /usr/share/doc/*\npath-exclude /usr/share/man/*' > /etc/dpkg/dpkg.cfg.d/01_nodoc \
&& echo "deb http://apt.postgresql.org/pub/repos/apt/ $(lsb_release -cs)-pgdg main" > /etc/apt/sources.list.d/pgdg.list \
&& curl -sS https://www.postgresql.org/media/keys/ACCC4CF8.asc | apt-key add - \
&& apt-get update -qq \
&& apt-get install -qqy --no-install-recommends \
nodejs \
yarn="$YARN_VERSION" \
libxmlsec1-dev \
install python3-lxml in preparation for migrating qti_migration_tool to python 3 once that migration is complete, we can remove the python 2 version refs DE-993 Change-Id: Iea25e7418c6e4bc87e639cc1883b216eea94ca6c Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282813 Reviewed-by: Andrea Cirulli <andrea.cirulli@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Jeremy Stanley <jeremy@instructure.com> Product-Review: Jeremy Stanley <jeremy@instructure.com>
2022-01-14 06:11:01 +08:00
python3-lxml \
stop installing python2 in docker images Change-Id: I1e6aae06c904d2fd57f2720057c7a1f1629680f2 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/295294 Reviewed-by: Jeremy Stanley <jeremy@instructure.com> Reviewed-by: Isaac Moore <isaac.moore@instructure.com> Product-Review: Jeremy Stanley <jeremy@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com>
2022-07-01 23:13:30 +08:00
python-is-python3 \
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
libicu-dev \
Replace our homegrown link finder with twitter-text While I am at it, decaffinate and typescriptify TextHelper fixes FOO-2987 Change-Id: I0b8f33a610bee737ea79ad24d8aec8f8e8051c49 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/299013 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: August Thornton <august@instructure.com> Product-Review: August Thornton <august@instructure.com> QA-Review: Jacob Burroughs <jburroughs@instructure.com> Build-Review: Bobby Buten <bobby.buten@instructure.com>
2022-08-18 23:44:07 +08:00
libidn11-dev \
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
parallel \
postgresql-client-$POSTGRES_CLIENT \
unzip \
pbzip2 \
fontforge \
Properly support ruby 2.7 Change-Id: Ie69cd8dc0b19dfc627afe8369e8e493744a62a8c Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/266943 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: Cody Cutrer <cody@instructure.com> QA-Review: Cody Cutrer <cody@instructure.com> Product-Review: Cody Cutrer <cody@instructure.com>
2021-06-12 00:42:24 +08:00
git \
build-essential \
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
&& rm -rf /var/lib/apt/lists/* \
&& mkdir -p /home/docker/.gem/ruby/$RUBY_MAJOR.0
Pulsar Dependencies closes FOO-1828 closes FOO-1829 closes FOO-1831 - add service to run pulsar locally in pulsar.yml - add apt-get dependencies to compile "rice" and "pulsar-client" - add dependency on pulsar-client gem Change-Id: Id942db70dc81fd977e907aff0702c7eda7f68820 Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/262287 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: Cody Cutrer <cody@instructure.com> QA-Review: Ethan Vizitei <evizitei@instructure.com> Product-Review: Ethan Vizitei <evizitei@instructure.com>
2021-04-06 04:46:04 +08:00
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
RUN if [ -e /var/lib/gems/$RUBY_MAJOR.0/gems/bundler-* ]; then BUNDLER_INSTALL="-i /var/lib/gems/$RUBY_MAJOR.0"; fi \
&& gem uninstall --all --ignore-dependencies --force $BUNDLER_INSTALL bundler \
raise bundler minimum requirement because of nokogiri, we rely on multi-platform gem caching, which only works right in bundler 2.2 Change-Id: Id207278946e849abec3418807c71e4650506a0cf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/259142 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: Jacob Burroughs <jburroughs@instructure.com> QA-Review: Cody Cutrer <cody@instructure.com> Product-Review: Cody Cutrer <cody@instructure.com>
2021-02-20 01:12:45 +08:00
&& gem install bundler --no-document -v $BUNDLER_VERSION \
convert alpine image into ubuntu image We originally experimented with an Alpine image for reduction in image size. However, a number of issues with Alpine have appeared that were unanticipated. 1. Alpine uses a different memory allocator 2. Alpine package manager deletes old versions once new ones are published. The first issue is the potential root cause behind random segmentation faults in our tests and we are reverting the Alpine change to eliminate the memory allocator difference as the cause. Test Plan: 1. Ensure that Jenkins image caching works correctly 2. Ensure that local docker build scripts work correctly Change-Id: I02b13d8c7117495d825a92e0a4be4e70b0e78caf Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/247283 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com> Reviewed-by: Ryan Norton <rnorton@instructure.com>
2020-09-10 07:44:21 +08:00
&& find $GEM_HOME ! -user docker | xargs chown docker:docker
say PLEASE to npx when running yarn-deduplicate because simply asking it to run yarn-deduplicate is no longer good enough, you must now be polite when doing it[1]: To prevent security and user-experience problems from mistyping package names, npx prompts before installing anything. Suppress this prompt with the -y or --yes option. we will also be updating npm to the latest to catch such issues in the future == test plan running "rake canvas:compile_assets" using npm > 7 completes without hanging indefinitely at the "install dependencies" stage [1]: https://docs.npmjs.com/cli/v7/commands/npx#compatibility-with-older-npx-versions Change-Id: I81e044d20143991cf6103084f44ce8d4c9011f5b Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/259662 Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> Reviewed-by: Aaron Ogata <aogata@instructure.com> QA-Review: Ahmad Amireh <ahmad@instructure.com> Product-Review: Ahmad Amireh <ahmad@instructure.com>
2021-03-02 02:42:47 +08:00
RUN npm install -g npm@latest && npm cache clean --force
split main Dockerfile & jenkins Dockerfile We want to use buildkit-specific Dockerfile commands on Jenkins for caching / performance reasons, but don’t want to force other users to use buildkit locally due to the inconvenience with environment variables. refs DE-208 Change-Id: Idbfaf589f72af7a40e16aa8d13fc5aaba7751edc Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/245311 Reviewed-by: James Butters <jbutters@instructure.com> Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com> QA-Review: Aaron Ogata <aogata@instructure.com> Product-Review: Aaron Ogata <aogata@instructure.com>
2020-08-18 05:30:26 +08:00
USER docker