Click here to Skip to main content
14,453,888 members

Welcome to the Lounge

   

For discussing anything related to a software developer's life but is not for programming questions. Got a programming question?

The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.
 
GeneralRe: Where do the gigabytes go? Pin
obermd21-Nov-19 4:28
Memberobermd21-Nov-19 4:28 
GeneralRe: Where do the gigabytes go? Pin
Rage20-Nov-19 7:19
professionalRage20-Nov-19 7:19 
GeneralRe: Where do the gigabytes go? Pin
Cp-Coder20-Nov-19 8:19
MemberCp-Coder20-Nov-19 8:19 
GeneralRe: Where do the gigabytes go? Pin
Nelek20-Nov-19 9:38
protectorNelek20-Nov-19 9:38 
GeneralRe: Where do the gigabytes go? Pin
Cp-Coder20-Nov-19 9:43
MemberCp-Coder20-Nov-19 9:43 
GeneralRe: Where do the gigabytes go? Pin
Member 798912220-Nov-19 23:00
MemberMember 798912220-Nov-19 23:00 
GeneralRe: Where do the gigabytes go? Pin
Nelek21-Nov-19 9:28
protectorNelek21-Nov-19 9:28 
GeneralRe: Where do the gigabytes go? Pin
Member 798912221-Nov-19 22:54
MemberMember 798912221-Nov-19 22:54 
That is what I do at my home computer, where I can discard the old image with no worries.

At work, there is a requirement that we - for years into the future - must be able to reconstruct the exact same development environment as was built to generate a given release, capable of building a bit identical copy of the released software. One consequence of that was that we would have to archive every single complete disk image. In principle, we could discard those that was never used for any release, but with many projects and many releases, the management problem would be large and the risk of missing info about a release (and deleting the image used to build it) was large. So we rejected that option.

I am far from being a great lover of Docker (especially on Windows, but even the Linux variant is ... well...), but it does solve a number of such problems. Once you have generated a Docker image, it is not affected by any environment changes (unless, of course, the build script fetches stuff from outside through the network interface). The way we have organized our images, in a multi-layered structure, it is very space efficient as well: If, say, one project requires a couple new/updated Python packages, we make a new image with the old one as base, and run a couple "pip install" to create a "varnish layer" that requires space measured in kilobytes. All the unchanged elements are physically shared with the old image (even at runtime).

So we have few if any disk space issues. Still we have issues: Some developers insist on using the latest and greatest version at any time (this goes particularly for Python packages). We could end up with thousands of Docker images, which would cause a significant management problem. So we let the developers use a "development" Python Docker image in the development phase, allowing downloading of any new version. In the relase phase, they are required to switch to a stable Python image that has disabled any network download: The project presents a list of packet versions they "need", we make a new varnish layer with these packets, and that is what is used for the relase build. This seems to be working fine - at least for now Smile | :)

(But that is for the Linux projects. Windows and Docker... arrrgh. We have given up for now. Maybe it will come later.)
GeneralRe: Where do the gigabytes go? Pin
maze321-Nov-19 0:28
professionalmaze321-Nov-19 0:28 
GeneralRe: Where do the gigabytes go? Pin
Member 1457777722-Nov-19 9:03
MemberMember 1457777722-Nov-19 9:03 
GeneralRe: Where do the gigabytes go? Pin
OriginalGriff22-Nov-19 9:04
communityengineerOriginalGriff22-Nov-19 9:04 
GeneralRe: Where do the gigabytes go? Pin
Member 1457777722-Nov-19 11:08
MemberMember 1457777722-Nov-19 11:08 
GeneralCCC Pin
pkfox19-Nov-19 23:57
professionalpkfox19-Nov-19 23:57 
GeneralRe: CCC Pin
Duncan Edwards Jones20-Nov-19 0:03
professionalDuncan Edwards Jones20-Nov-19 0:03 
GeneralRe: CCC Pin
pkfox20-Nov-19 0:23
professionalpkfox20-Nov-19 0:23 
GeneralRe: CCC Pin
OriginalGriff20-Nov-19 0:39
communityengineerOriginalGriff20-Nov-19 0:39 
GeneralRe: CCC Pin
OriginalGriff20-Nov-19 1:05
communityengineerOriginalGriff20-Nov-19 1:05 
GeneralRe: CCC Pin
lw@zi 20-Nov-19 1:11
professional lw@zi 20-Nov-19 1:11 
GeneralRe: CCC Pin
digimanus20-Nov-19 1:58
Memberdigimanus20-Nov-19 1:58 
GeneralRe: CCC Pin
pkfox20-Nov-19 2:42
professionalpkfox20-Nov-19 2:42 
GeneralReal news, from the future! Pin
Super Lloyd19-Nov-19 23:20
MemberSuper Lloyd19-Nov-19 23:20 
GeneralRe: Real news, from the future! Pin
RickZeeland20-Nov-19 0:32
communityengineerRickZeeland20-Nov-19 0:32 
GeneralMini CCCs 146 Pin
Tim Deveaux19-Nov-19 20:34
MemberTim Deveaux19-Nov-19 20:34 
GeneralRe: Mini CCCs 146 Pin
pkfox20-Nov-19 2:45
professionalpkfox20-Nov-19 2:45 
GeneralRe: Mini CCCs 146 - Done Pin
Tim Deveaux20-Nov-19 4:54
MemberTim Deveaux20-Nov-19 4:54 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.