|
Tika has a PDF parser. Among many others.
Apache Tika – Apache Tika[^]
You would of course still need to code to each individual different format.
(Note that there are even image parsers.)
|
|
|
|
|
The title os this message might look like a joke, but it is actually very serious.
The other day I wanted to implement my own BigInteger class, and I was using bytes as the backing fields. Yet, I would only use values from 0 to 9 for each digit.
Bing AI suggested me to create an enum with values ranging from D0 to D9 (I think their actual values are obvious).
Yet, using an enum like that doesn't forbid users from doing things like (DecimalDigit)56 and pass 56 to an enum that was only supposed to support values ranging from 0 to 9.
Of course I can validate the values at run-time... but the entire purpose of using an enum was to avoid mistakes like that.
So, my solution was to create a class (in fact, a struct, but a class serves the same purpose) that has a private constructor, and has public static readonly fields ranging from D0 to D9. This way, users outside of the class, except if they really want to mess up (like using unsafe reflection) cannot pass values that aren't in the 0-9 range.
This also reminded me of a job where we had one enum with like 20 values... and then, many, many, many switches to get the many different traits of those enums.
Wouldn't it be better to just have classes, with all the traits, and use the classes?
Aside from the use of the enum in switch statements, they work the same in most cases, work even easier in cases where we usually had to use helper methods... and if a new trait is added, we have a single place (where the enum values are declared) to fix... with no chance of "forgetting" a case in a switch somewhere else.
What do you guys think?
Example:
public struct DecimalDigit
{
public static readonly DecimalDigit D0 = new(0);
public static readonly DecimalDigit D1 = new(1);
public static readonly DecimalDigit D2 = new(2);
public static readonly DecimalDigit D3 = new(3);
public static readonly DecimalDigit D4 = new(4);
public static readonly DecimalDigit D5 = new(5);
public static readonly DecimalDigit D6 = new(6);
public static readonly DecimalDigit D7 = new(7);
public static readonly DecimalDigit D8 = new(8);
public static readonly DecimalDigit D9 = new(9);
private DecimalDigit(byte value)
{
_value = value;
}
private readonly byte _value;
public byte ByteValue
{
get => _value;
}
}
public enum DecimalDigit:
byte
{
D0,
D1,
D2,
D3,
D4,
D5,
D6,
D7,
D8,
D9
}
Notice that although the enum version is smaller, if we need to add names for the values, in the class we just add a property, for the real enum, we create a helper method.
If we need to convert them to numbers, add an emoji or whatever, in the first version it is just a matter of adapting the class, while in the second it is a matter of creating more (and somewhat unrelated) methods.
Edit: I had some questions about why create a new decimal class. There is not a real need to create one. I just wanted to do it as an exercise. I can tell that .NET implemented BigInteger is way faster than my class. Yet, just by writing the UnsignedDecimalInteger I saw opportunities to write Quadbits (effectively, half of a hexadecimal value... or just 4 bits), so in one byte I can store 2 Quadbits. I also saw opportunities for caching of the internal buffers I use... and I am just "relearning" how to do math the "old way" using decimal values. I will, at some point, improve it to use 32 or 64 bits at once.
Also, one of the next steps, be it with BigInteger or my UnsigedDecimalInteger, is to create a BigDecimal or similar class. In fact, having a value alone (without caring about operations), I just need to have a value telling where the dot separating the integer part and the fractional part. Or, I can literally have two BigInteger (or similar), one for the left side, and one for the right side, of the decimal.
modified 1-Aug-23 18:09pm.
|
|
|
|
|
I use .IsDigit more often than defining what one is. Enums make code more readable. And can save storage.
"Before entering on an understanding, I have meditated for a long time, and have foreseen what might happen. It is not genius which reveals to me suddenly, secretly, what I have to say or to do in a circumstance unexpected by other people; it is reflection, it is meditation." - Napoleon I
|
|
|
|
|
Your DecimalDigit struct should be marked as readonly, since it will never be mutated.
You could also replace the backing field with a read-only auto property.
You'll probably want to implement IEquatable<T>, and possibly IComparable<T>. And override ToString. At which point, it might be better to use a readonly record struct.
And after all that, without having to resort to reflection or unsafe code, you can still create an invalid instance:
ReadOnlySpan<byte> span = new byte[] { 42 };
DecimalDigit digit = System.Runtime.InteropServices.MemoryMarshal.Read<DecimalDigit>(span);
Console.WriteLine(digit.ByteValue);
"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer
|
|
|
|
|
Thanks, I forgot I can make the entire struct final.
Yet, I wouldn't get rid of the backing field... I don't like to make a class/struct use property getters instead of using their fields directly... that's really a personal choice.
In any case, I will mark the struct as readonly. Thanks for reminding me of that!
|
|
|
|
|
Question... if I have an array of my struct... the array itself is readonly... yet I can modify the contents of the array... should I mark the class readonly because I never replace one array by another, or not, as there are mutator methods to change the contents of the inner array?
|
|
|
|
|
You can't mark a class as readonly; only a struct.
And a struct containing an array of structs is probably a bad idea - the entire array would need to be stored inline as part of the outer structs data. 
"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer
|
|
|
|
|
The real class implements IEquatable and IComparable. I simply didn't want to make the code to huge for this discussion.
And, even though Marshal methods aren't marked as unsafe they are, by definition, unsafe. In fact, reflection itself is not called unsafe, although you can create empty instances of classes that do not define default constructors and the like...
|
|
|
|
|
Paulo Zemek wrote: to implement my own BigInteger class,
Idea: add information to your post about why you want/need to do this.
What functionality does the MS BigInteger Struct provide that you need extended, modified, etc. [^]
? [^]
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
|
|
|
|
|
Skipping the class/struct/readonly/whatever discussions, and commenting on the subject line topic: Enums.
My programming childhood (i.e. as a university freshman) was with Pascal, which provided true enums. Not named integers. In the C language class, replacing integer #define with enum is just syntactical sugar. They are integers in disguise. Or not really disguise - it is just a very thin veil.
The very idea behind enums is that they are not integers, no matter what C programmers say. January, February and so on are months, not integers! May is May. It takes a C programmer to get into an argument whether the month of May "really" is 4 or 5. Well, the C programmer would never be in doubt. Also, half of May is March, that is obvious, isn't it? (Half of June is also March.)
Noooo! Enums are countable (enumerable, if you prefer). So are apples. That doesn't make an apple an integer.
If you are really talking about integers, they are integers. Replacing the digit 0 with 'D0', 1 with 'D1' and so on does not, not in any way whatsoever, 'improve legibility'. Quite to the contrary; it hides the fact that you are in fact talking about integer numbers. The reader has to look up the definition of 'D4' to see what it represents: Is it the binary integer 4, or is is the character code for the '4' digit character, or something quite different, such as 'dictionary entry with key 4'?
Enums have no place in this context of yours - not even in the C-style 'enums are named integers' style. You are handling true integers. Declare them as true integers, and nothing else.
(And: If Pascal had still been alive, you could have had exactly what you are trying to achieve defining new subrange type such as TYPE SingleDigitInteger = 0 ..9; and the compiler + runtime system would catch all attempts to set a variable/field of this type to a value outside its defined range. It would still be a numeric integer. Unfortunately, Pascal, and a lot of great ideas it represented, died several decades ago.)
|
|
|
|
|
You got it... the real purpose was to have a Range<0, 9>.
That's something I can easily do in C++ templates... and it would avoid enums altogether... and also classes that act as enums.
|
|
|
|
|
An enum representing the numbers 0 through 9 is worse than useless, actually harmful even, since you will do arithmetic on them.
|
|
|
|
|
I am creating a new kind of "development" platform that uses a custom data model (custom classes etc...). The thing is that the development is going to require a significant amount of collaboration and work by different users (members of a team), potentially all at once. All data needs to stored in one place. In the end it would work somewhat similar to a code management system but it isn't code being developed and that comparison is somewhat superficial. A centralized system harvests tasks (based on information gathered) from the internet and those tasks get distributed among specialists to look at the data, standardize it, format it, build upon it, and submit it for integration into the main "fork"/trunk so to speak. I am probably looking at a client-server model but since this approach to data storage, programming, and most importantly, data sharing is entirely new to me, I am not certain which model to use and not sure where to look to find information to teach me how to build such an application/data model. Internet searches so far get too broad of results that aren't helpful (such as how to use and distribute a database or information on data services). Any pointers to get me started? I am also looking for a secure place/server to store the data for people on the team to access. It doesn't need to be incredibly big. Frankly Google Drive is plenty of space. Not sure how I would leverage that though (through the software).
modified 30-Jul-23 2:30am.
|
|
|
|
|
How do you decide whether the data can be merged? Can multiple people be touching the same data at the same time?
|
|
|
|
|
It is merged after it is reviewed. Once I gain confidence that a team member is doing what I need them to, following the vision I have, they would have rights to merge it themselves.
"Can multiple people be touching the same data at the same time?" Same target/source files... yes. Same actual data, no (though theoretically it could happen... would probably have to write checks/locks into the code). The approach I intend on taking is to hire different people with different strengths and backgrounds so each individual task would only be touched by one team member.
|
|
|
|
|
To be honest, what you have described so far instantly led me to think of event sourcing. The idea behind this is that you don't change state, instead you save a new event everytime something changes. So, when you view the "thing", behind the scenes, every event is replayed to create the state as it currently is. When you accept the review, you could create a snapshot of the fully played event if you wanted to provide a "final state" for that particular item.
You can find more information about this here[^].
|
|
|
|
|
what a gem of a thought to sparkle in this strange thread !
thanks, Bill
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
|
|
|
|
|
pr1mem0ver wrote: development is going to require a significant amount of collaboration and work by different users (members of a team), potentially all at once. All data needs to stored in one place. In the end it would work somewhat similar to a code management system but it isn't code being developed and that comparison is somewhat superficial.
How would you motivate anyone else to participate in such a vague plan ?
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
|
|
|
|
|
Money? 
"I have no idea what I did, but I'm taking full credit for it." - ThisOldTony
"Common sense is so rare these days, it should be classified as a super power" - Random T-shirt
AntiTwitter: @DalekDave is now a follower!
|
|
|
|
|
reads like recruitment for a no-$ build a field of dreams to me.
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
modified 30-Jul-23 20:32pm.
|
|
|
|
|
Wow... you guys make all kinds of incorrect assumptions and right now I am so angry that I may just quit this forum myself after being a member for years. I have NEVER been treated this way here before. No need to kick me off. This is a legitimate question. I only use this forum when I need help. I am programming it myself if I can. I don't want help with the actual programming if I can avoid it so I am not looking for programmers. You people don't even have the expertise I am looking for so bug off. Otherwise answer my question. I just need some advice.
|
|
|
|
|
pr1mem0ver wrote: I am so angry that I may just quit this forum ... You people don't even have the expertise I am looking for so bug off
Thanks for sharing how you really feel.
And, what a nice surprise to know you plan on patenting whatever you are talking about.
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
|
|
|
|
|
LOL. IF I remain on this site, I will post the patent here when I get it. If I am able to finish the project, it will happen. I love how you all feel your experience in programming entitles you to points. I find it terribly ironic I can upvote my own comments. Honestly, I don't give a rats butt about my reputation here. I only come to help myself and others in repayment. It's really a shame that folks like you pick and choose to ruin it for other people. You guys continue to make erroneous assumptions about everything under the sun, talking about everything EXCEPT the answer to the question I asked. After this crap treatment I won't bother coming here again to ask questions. So rest easy and pat yourself on the back for making your point on a job well done. I also won't have anything nice to say about this forum anymore. I know you don't care but oh well... can't help that. I am an elementary school teacher for Pete's sake.
|
|
|
|
|
It either has to be something that really appeals to someone's altruism, or it has to be financial.
|
|
|
|
|
Actually both apply here. Honestly, I am having difficulty with the pricing model because yes... what I am building will provide a much needed resource in education and instructional design (both public and private) and I don't want people to have to pay significant sums of money for the "much needed" aspect of what I am building. At the same time, it would be nice to make some money because as a teacher I get paid relatively little.
|
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
