|
A colleague was just complaining about a new language+library that he was using for big data.
The complaint:
Too many "magical" conversions were taking place under the covers. Often processing the data in non-optimal ways, and not an easy way to force better ways to process it because of poor library design.
Per dates and formats. Dates/DateTimes in codes should be some sort of numeric type (possibly wrapped) and always in UTC. As someone else mentioned, display of dates (including timezones) should be a user preference or a replaceable component that mimics being a user preference.
|
|
|
|
|
I faced a similar problem just recently. The solution was to let the compiler handle the endianness. Integers, Chars (multibyte/Unicode in that context), all work the same way in the same language.
I don't cast/convert between integers and chars because the one is numbers, the other is characters, letters. If a conversion is needed, the compiler offers conversion functions that work the same independent of the platform.
Same for data declarations, in C(++), a uint16_t is unambiguous. Across languages however, don't see how that's supposed to work. What's even the point of piping a C source file into a Delphi compiler or vise versa?
This technique naturally results in my tools behaving the same on every platform the compiler offers.
Your post reminds me on a nightmare from a coworker I fixed a while ago. He was parsing a protocol with the bytestream containing, amongst other things, integers. The protocol is LE, the system the parser's running on is LE (Windows x86-64), all things work splendidly. For 1, 2 and 4 byte-integers that is. Just cast it! And to parse 3-byte integers, he built a monster of bit shifts and whatnot.
I've replaced his horrible mess with somewhat simple code that initializes the result to 0 and then adds byte by byte multiplying it accordingly. Viola, problem solved, function is simple and works for an arbitrary number of bytes.
|
|
|
|
|
Your 3 byte integer problem is exactly the kind of work-around that causes problems. I like your solution to the LE problem--simple and directly understandable.
But, what if we didn't have to think about it? What if the variable could be defined as "3 byte little endian integer" and the conversion to/from machine requirements took place automatically on all future references? How could something like that be implemented at the language, compiler or machine level?
I cannot tell you how many times I've seen "char" definitions used inappropriately when a "byte" definition would make more sense. Or things like:
"memcpy( (char *) &structa, (char *) &structb, 100 );"
(And if someone says they have never done something like that, I say "BULL!". They've done it one way or another in whatever language except perhaps LISP or SNOBOL).
Just thinking.
|
|
|
|
|
But we already have that! Let's forget the 3-byte-integer for a moment, that's rather specific to that protocol and usually not needed. When I work with a int32_t (a rather common type), I don't have to care which endianness the underlying system uses. The compiler takes care of everything! Same goes for, let's say, uintptr_t. I don't have to care about endianness, bitness, none of that. The compiler does it for me. Well, I of course have to work with the compiler, but your world, the one where the programmer doesn't have to care, is already there.
The other topic here is that people will always find a way to circumvent the compiler and shoot themselves in the foot.
There's languages that make that easier or harder, C is the worst offender I've ever met (save for assembly, but that's in a league of it's own). C doesn't even have a byte type! A char is a byte in C, you can't blame the programmer (except for possibly poor choice of C as a tool). Switch the language. C# or Delphi on the other hand, those compilers yell at you when you're doing questionable things. And if that thing in question may work just fine while still remaining questinable, you'll at least get a warning.
Feel free to yell BULL, by the way. I've never done such a thing because the question is not whether it'll blow up in my face but a mere when. It will blow up sooner or later.
Fun fact: I've now spent about two weeks fixing a binary communication layer. Some predecessor of mine thought that using strings, data structures designed for text, where binary information is processed, would be a splendid idea. And then came Unicode. Trying to convert 99h to a Unicode string member yields 3Fh and some other byte I've forgotten. I bet it was a C programmer who grew up in the 60s riding the "Learned it once, never relearn"-mentality. Converted all of this nonsense to TArray<Byte> (Delphi nomenclature) and stuff works now.
I still wonder whether your topic is about programming in general C in particular as you seem insistent on issues that are long solved by several programming languages (granted, both Delphi and C# still allow you to shoot yourself in the foot, but you gotta fight hard against the compiler to do that).
|
|
|
|
|
Sounds just like VB6 to me. I still can't figure out why the "elitists" hate it so much. Other than the name, of course. 
If you don't like "GoTo" don't use it.
Slow Eddie
|
|
|
|
|
You and every other quality technician...
Seriously though, the problem is that as a profession we have no real enforced standards. Microsoft attempted to be a standard bearer in the 1990s and early 2000s but everyone complained and now we have the morass that technicians are just starting to rightly complain about.
The other issue is that we have too many technicians in our ranks that are too eager to promote their own vision of things at the drop of a hat since using a tool that may be one or more years old may not be cool.
First the major organizations destroyed the vital functions of IT development and then the technical community got on board and started doing the job for them.
Now you have aberrations like MVC replacing Web Forms when it was already available and no one on the Microsoft side of things was interested until that company promoted its own version of MVC (most likely a direct copy of the original).
Now you have JavaScript as a major language though it is a major headache to code with.
Now you have Agile and DevOps, which in reality are diametrically opposed to quality software engineering standards.
And now you have new tool-sets being introduced on a daily basis by anyone who thinks they know what they are doing.
In short, the entire profession is a complete mess.
And it ain't going to get better in the current economic environments of barbaric capitalism...
Steve Naidamast
Sr. Software Engineer
Black Falcon Software, Inc.
blackfalconsoftware@outlook.com
|
|
|
|
|
You said it all when you said "the entire profession is a mess."
That's why I'm asking the question.
|
|
|
|
|
I feel your pain.
Here is the dilemma: Ease of use for the programmer.
As a programmer, I don't want to declare:
int4,int8,int16. The concept was that int was the DEFAULT machines bitness, which allowed it to move across platform. In memory this is great. Reading/writing to disk, created the Endian problem.
Then when you are not looking you get coercion of types, etc. Add in signed/unsigned, and pretty soon you realize you need a completely Object Based system.
To fix what?
Write once test everywhere?
I feel your pain, but see no solution outside of custom managing types that go into and out of some kind of storage!
|
|
|
|
|
Write once, run everywhere.
How many times have you heard a senior management type say "We need it to run on Windows laptops for Accounting but Marketing uses Macs and Engineering uses Linux. And by the way, can you make it accessible from my phone?"
If I had a nickel for every time I've heard that, I would make Bill Gates and Warren Buffet combined look like paupers.
|
|
|
|
|
That's why the DOCKER concept was so exciting to me, to be honest.
UCSD Pascal had a runtime. Under DOS it was dog slow, but the idea was basically a VM...
It ran on Linux and DOS the same, and anywhere else they ported that too, if memory serves me.
Imagine a world where (X-windows tried this), you run your application, and the GUI attaches to it!
Meaning you need only configure standard IO parameters.
Now, this was the beginning of EVERY COBOL program (remember: Environment Division, etc).
We have evolved really far, and we are getting places.
The one upside of the web was a "Standard" GUI available to program to.
Making things like Proton or Docker with a port to do things workable across platforms.
And I see that is where we seem to be going.
But like Scotty in Star Trek said "The fancier the plumbing, the bigger the problems" (or some such)
|
|
|
|
|
For years the image of developers has been the living in their parent's basement, never sees the light of day, lives on sodas and pizza.
For many, I am sure this might actually be accurate (I know at least one person who precisely matches this description - he used to write video codecs for fun).
For the rest of us I am sure travel and enlightenment (and occasionally family) are just as important. I have worked and lived in five countries and visited many more. Here are my lists:
Lived in: England, Sweden, Germany, France, USA
Additionally visited: Austria, Belgium, Netherlands, Czech Republic, Switzerland, Italy, Monaco, Scotland, Wales, Tunisia, Barbados, Jamaica, Grand Cayman, Crete, Corfu, Hong Kong (deployed - didn't see the city), Luxemburg, Lichtenstein, Mexico, Canada and sundry US States.
Bucket list: New Zealand, Iceland, Russia (maybe), India, Hong Kong (now it's no longer British), Norway, Denmark, The Moon (low-gravity retirement home). ...and Japan.
Where have you worked/lived/visited/been deployed?
- I would love to change the world, but they won’t give me the source code.
modified 27-Mar-19 13:31pm.
|
|
|
|
|
Lived in: UK
Worked in: UK
Bucket list: Get the kids off my lawn
|
|
|
|
|
F-ES Sitecore wrote: Get the kids off my lawn
Whose kids?
"It is easy to decipher extraterrestrial signals after deciphering Javascript and VB6 themselves.", ISanti[ ^]
|
|
|
|
|
I have lived/visited/worked in 10 countries so far. Now that I am in Netherlands, that number will increase a lot due to open borders. 
I still have not been in South America so any country from there would be fun!
"It is easy to decipher extraterrestrial signals after deciphering Javascript and VB6 themselves.", ISanti[ ^]
|
|
|
|
|
|
I live in the Netherlands and I've been to Iceland, Norway, Sweden, Finland, Russia (Sint-Petersburg), Estonia, Ireland, Wales, Scotland, Belgium, Luxembourg, Austria, Czechia, Slovakia, Poland, Hungary (Budapest), Slovenia, France, Italy, Spain (Barcelona), Madeira (does that count as Portugal?), Tunisia (Tunis), Malta, Greece, Israel, Kenya (where the giraffes are and the zebraaaas, forget Norway!), Indonesia, Canada, Costa Rica, Suriname and Cuba.
Not in that order.
Now that I'm counting them that's one country a year on average since I'm born (I'm 31) 
And, my favorite country of them all, Germany!
It's beautiful, it has mountains, forests and plenty of castles and, huge bonus, it's relatively close to home!
Perfect for a couple of days out of the house
According to TripAdvisor I've seen 18% of the world...
Japan and New Zealand are on my bucket list.
|
|
|
|
|
Oops! I forgot Japan for my bucket list.
- I would love to change the world, but they won’t give me the source code.
|
|
|
|
|
I am a Jet Setter. Ok maybe 85 octane.
Southern California in the 80s when tech was king and money flowed like water.
Summit County Colorado where there is Moose, Elk and Bear and just enough tech to keep us above water.
|
|
|
|
|
I did became a computer addict in my parents house (no basement, but used the most remote room and the attached - closed - balcony)...
Lived only in Hungary and Israel so far, but visited in England (London only), France (south, along the Spanish border), West and East Germany, Italy (Milan), Poland, Czech Republic, Romania, Yugoslavia, Bulgaria...
I do not plan to visit places abroad for now... There are a lot of places nearby that I want to see (and show to the kids) before that...
"The greatest enemy of knowledge is not ignorance, it is the illusion of knowledge". Stephen Hawking, 1942- 2018
|
|
|
|
|
Environment friendly too, all that kerosine guzzling flying around the globe is not good at all 
|
|
|
|
|
lived in: England, Germany, Canada (4 months), Northern Ireland, technically Australia but I was delivering software to someone in an airport.
Visted: Italy, Czech republic, Spain & islands, Portugal
Bucket List: St Petersburg, Caribbean, Various places in the USA, Japan, China, New Zealand, Australia, Sweden and other nordic regions
I have lived in various places in Germany but that was due to my father being in the armed forces and got to see Berlin before the wall came down, as the wall came down and immediatley after. But would love to visit again.
Every day, thousands of innocent plants are killed by vegetarians.
Help end the violence EAT BACON
|
|
|
|
|
Forogar wrote: Where have you worked/lived/visited/been deployed?
I've lived in the USA, Venezuela, Mexico and Bolivia and visited Aruba, Ecuador, Colombia, Suriname, Brazil, Argentina,Peru, Canada,England, The Netherlands,Malaysia, Indonesia, Japan, Hong Kong, Singapore, and likely a few other places.
I have a trip to Malaysia in the works later this year and will return to Venezuela as soon as the situation there stabilizes.
In addition, besides taking time off when
I had a stroke, I completed my PHD, sdo I've managed to get out and stay busy.
CQ de W5ALT
Walt Fair, Jr., P. E.
Comport Computing
Specializing in Technical Engineering Software
|
|
|
|
|
Oh, this game looks interesting.
Lived in: New Zealand, New York, Paris, Sydney, Melbourne
Visited: Singapore, Indonesia, Malaysia, Thailand, Laos, Cambodia, Viet Nam, Hong Kong, China, Fiji, India, Croatia, Hungary, Czechoslovakia, Spain, Germany, Italy, England, Netherlands, Sweden, Norway, Latvia, Russia (trans-Siberian train trip), Canada, Mexico, Peru, Chile, Argentina (5 months in South America, 10,000kms on a motorbike) and Antarctica.
Haven't been to Africa yet, and would love to spend more time in Europe. Problem with living back in NZ is everywhere is so far away.
Oh, and I've seen NZ on bucket lists - drop me a note when you've got plans to come visit.
|
|
|
|
|
Lived in: United Kingdom, Israel & Japan.
Worked in: Israel, Japan (I'm not counting business trips  )
Worked with: Israelis, Japanese, Chinese, Americans, Brits, Indians, Russians, and too many other nationalities to count.
Visited: United Kingdom (England, Scotland), France, Switzerland, Italy, Lichtenstein, Denmark, Holland, Japan, Hong Kong, China, United States, South Africa, Canada, Germany.
Bucket list: Anywhere off the planet (unlikely, given the current spaceflight technology  )
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows.
-- 6079 Smith W.
|
|
|
|
|
Oops, I forgot to add Lichtenstein. to my visited list. I would have missed it if I'd blinked and hadn't had to stop at the traffic lights. 
- I would love to change the world, but they won’t give me the source code.
|
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
