|
Hi,
I have and SSIS Package, my lead wants me to create a C# application that sets Variables, Connections and everything properly and executes the package, I did that, I even have written OnError event and logged the Error why SSIS failed to execute. As far I saw there is no difference between my Application and SQL Job. In fact my Application is logging every detail and placing all details as I am logging many things and its priority based logging means logs depending upon the Environment. But just asking, is it good Idea to write my own Application or did I do wrong?
My lead wanted to do it this way because there are many SSIS packages and because the SQL jobs they are running sometimes same time and creating lot of mess. But my application does it synchronously and it combines this synchronous process with another Asynchronous process of FileSystemWatcher, which keeps a record into the Database when file is dropped and then my App would take those details of path etc sets the connections and variables then calls the SSIS packages Synchronously and kills the execution of SSIS package if its taking too long. All these features are implemented by using C# code, if anybody has better advise please let me know their opinions.
Just want to calculate pros and cons from some other developers just to check my process, in fact I believe all Programmers are always learners  .
Thanks,
Abdul Aleem
"There is already enough hatred in the world lets spread love, compassion and affection."
|
|
|
|
|
Using C# to kick off SSIS jobs is just fine. I've done it too and it works great. It sounds like you built a good system. 
There are two kinds of people in the world: those who can extrapolate from incomplete data.
There are only 10 types of people in the world, those who understand binary and those who don't.
|
|
|
|
|
Thanks my friend
Thanks,
Abdul Aleem
"There is already enough hatred in the world lets spread love, compassion and affection."
|
|
|
|
|
Yeah, I've worked on systems where we built C# (and dare I say it, VB6) apps to monitor, trigger, kill SSIS packages. To be fair most of them began their existence before MS introduced all of the help that is now available with SQL Jobs... but the extra level of *specific* logging far outweighed the "out of the box" solution. When you are in a situation where there are many packages / jobs/ etc sometimes that extra level of customisation can pay for itself
|
|
|
|
|
Thanks my friend, yeah logging was needed I just want to know what's going on inside of its execution, but its priority based though that, in Dev it sets to lowest priority but in Prod it writes only Exceptions and Failures only.
Thanks,
Abdul Aleem
"There is already enough hatred in the world lets spread love, compassion and affection."
|
|
|
|
|
I have this flattened database design, and in checkout, I need to get the total weight of the cart items.
So I did a method call to the shopping cart and I have the items in a List,
But I need to get the Product Dimensions in another table that I did not join, because I used the database table to store the data in and I don't have a place to store the dimensions.
I'm not sure if I should rewrite this again, or if there is a quick fast way to get the dimensions.
I really don't want to make another model to do this.
if (context.SHOPPING_CART.Any(m => m.customer_accountName == aN))
sCs = context.SHOPPING_CART.Where(m => m.customer_ID == cID).ToList();
if (sCs != null)
{
orderTotal = sCs.Sum(m => m.item_Price_Value * m.item_Qty);
orderCost = sCs.Sum(m => m.item_Cost_Value * m.item_Qty);
orderProfit = orderTotal - orderCost;
orderWeight = "was hoping for quick method here"
}
PRODUCT_DIMENSIONS
Weight_Gravity is the field that I want to join so I can sum.
Globalism is Socialism on a planetary scale.
|
|
|
|
|
What's the structure of the database / EF model?
And are you really only going to allow each customer to have a single cart? Or are you going to delete the cart once it's processed?
jkirkerx wrote:
if (context.SHOPPING_CART.Any(m => m.customer_accountName == aN))
sCs = context.SHOPPING_CART.Where(m => m.customer_ID == cID).ToList();
Not sure what purpose that "if" serves? The condition doesn't match the following Where clause; and even if it did, it would only slow down the performance of your code.
"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer
|
|
|
|
|
On the design of the cart, I decided to use a field called "Account Name". At first when an account does not exist, I use the session number in the "Account Name" field. Then I try to lure the shopper into creating an account or upon checkout, they create an account. Once the account is created, I write a cookie with their info and swap the session number with the account name. Now the stage is set for each time the cart page is loaded, I can load their items automatically, from any device they use such as phone or desktop.
Upon PlaceOrder, the Linq I'm asking about, the cart content will be copied to another table and the shopping cart will be deleted.
This is the program at it's current state,
[Project Indigo] - test drive store.
There's a table called "Product_Info" that contains the master product information, In which "Product_Dimensions" can be joined to.
[Table("dbo.SHOPPING_CART")]
public class SHOPPING_CART
{
[Key()]
[Column(Order = 1)]
[DatabaseGenerated(DatabaseGeneratedOption.Identity)]
public int cart_ID { get; set; }
[Required]
public int customer_ID { get; set; }
[Required]
[MaxLength(80)]
public string customer_accountName { get; set; }
[Required]
public DateTime timeStamp { get; set; }
[Required]
[MaxLength(80)]
public string item_Type { get; set; }
[Required]
public int item_ID { get; set; }
[Required]
public int item_Qty { get; set; }
public bool item_Taxable { get; set; }
[MaxLength(80)]
public string item_SKU { get; set; }
[MaxLength(160)]
public string item_Description_Title { get; set; }
[Required]
public decimal item_Cost_Value { get; set; }
public decimal item_RollCharge_Value { get; set; }
[Required]
public decimal item_Price_Value { get; set; }
[Required]
public decimal item_Total_Value { get; set; }
public int item_Avatar_ID { get; set; }
public byte[] item_Avatar_Data { get; set; }
[MaxLength(210)]
public string item_Avatar_Url { get; set; }
[MaxLength(10)]
public string type_Currency { get; set; }
[MaxLength(10)]
public string type_Weight { get; set; }
[MaxLength(80)]
public string type_Unit { get; set; }
public int vendor_ID { get; set; }
[MaxLength(160)]
public string vendor_Name { get; set; }
public int brand_ID { get; set; }
[MaxLength(160)]
public string brand_Name { get; set; }
public int department_ID { get; set; }
[MaxLength(160)]
public string department_Name { get; set; }<br />
}
[Table("dbo.PRODUCT_DIMENSIONS")]
public class PRODUCT_DIMENSIONS
{
[Key()]
[Column(Order = 1)]
[DatabaseGenerated(DatabaseGeneratedOption.Identity)]
public int DimensionID { get; set; }
public int ProductID { get; set; }
public decimal Weight_Gravity { get; set; }
[MaxLength(6)]
public string Weight_Type { get; set; }
public decimal Size_Length { get; set; }
public decimal Size_Width { get; set; }
public decimal Size_Height { get; set; }
[MaxLength(4)]
public string Size_Type { get; set; }
}
Globalism is Socialism on a planetary scale.
|
|
|
|
|
I think I'm going to throw that code in the trash and start again with a model to populate instead; split up the function into a load, calculate and then write.
Globalism is Socialism on a planetary scale.
|
|
|
|
|
I'd be inclined to normalize that table a lot more. You'd probably want something more like:
- Products - SKU, type, taxable, prices, weights, brand, department, vendor, etc.
- Customers - ID, account name, etc.
- Carts - ID, customer ID, etc.
- Items - ID, cart ID, product ID, quantity, price
Depending on your design, it might make sense to duplicate the product data on the lines for a processed cart. But "in-progress" carts should be referring back to the master product list.
"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer
|
|
|
|
|
I went too far on duplicating fields in the shopping cart.
Now that I have the Automatic Migration working, I think I'll trim that down.
Globalism is Socialism on a planetary scale.
|
|
|
|
|
I shorted it down to this, and will just do a join to the master product table.
Would you include the price or leave that out as well?
public class SHOPPING_CART
{
[Key()]
[Column(Order = 1)]
[DatabaseGenerated(DatabaseGeneratedOption.Identity)]
public int cart_ID { get; set; }
[Required]
public int customer_ID { get; set; }
[Required]
[MaxLength(80)]
public string customer_accountName { get; set; }
[Required]
public DateTime timeStamp { get; set; }
[Required]
[MaxLength(80)]
public string item_Type { get; set; }
[Required]
public int item_ID { get; set; }
[Required]
public int item_Qty { get; set; }
}
Globalism is Socialism on a planetary scale.
|
|
|
|
|
Since you don't seem to have quantity breaks or any other complicated calculations, and you're removing the cart once it's processed, I'd be inclined to leave the price on the product.
"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer
|
|
|
|
|
Just out of the topic, but I am asking this here because I want to directly ask you, your caption says "Globalism is Socialism on a planetary scale", how, do you mean Socialism is nothing but imposing unwanted rules on mass people?, is it in that way?
Thanks,
Abdul Aleem
"There is already enough hatred in the world lets spread love, compassion and affection."
|
|
|
|
|
I changed it to "21st century globalism is socialism on a planetary scale", makes more sense now.
I seriously doubt anyone cares why I think this now, and I would private message you why, but I think they removed the private message feature; can't find yours. And I don't want to violate the rules of the forum by posting my thoughts on this. But I do have a well detailed anwser for it.
21st Century Globalism has become Socialism on a planetary scale, in which the unequal treaties of the past have come back into play.
|
|
|
|
|
It doesn't matter for me my friend, its just your opinion as I will have mine, I respect your opinion but just asked what was your logic in it. We have both things in our genes that's to protect our territory and to cross territory, it came from animal genes that they were our fathers millions of millions of years back as per Darwin sir
Thanks,
Abdul Aleem
"There is already enough hatred in the world lets spread love, compassion and affection."
modified 6-Dec-16 20:17pm.
|
|
|
|
|
Sign Up | LinkedIn[^]
My contact info is here, just drop me an email and then I will delete this post
21st Century Globalism has become Socialism on a planetary scale, in which the unequal treaties of the past have come back into play.
|
|
|
|
|
I am writing a application that are going to run on small NAS servers using Java.
For that purpose I am looking for a nosql database that can be embedded in my application.
Another requirement I have is that is should be possible to connect to the database from remote clients.
Thats is, piece of cake.  Beside those two requirements I am prepared to adapt my application to the database.
I know for example of MongoDB, Neo4J and OrientDB but have no experience of running them on small CPUs.
Any tips, tricks or recommendations.
//lg
/happy amateur
|
|
|
|
|
Create your own engine for minimal XML-based data sources. Your programs will read, write the data to these XML data sources and you can relax while it works on low-power CPUs too.
I personally use JSON for my regular day tasks instead of XML, but you can select either, then write an engine for that; CRUD functions and a bit of validation etc.
Create, read, update and delete - Wikipedia[^]
The sh*t I complain about
It's like there ain't a cloud in the sky and it's raining out - Eminem
~! Firewall !~
|
|
|
|
|
I've been faffing around with MariaDB with the view to converting our SQL Server Apps. First step is to convert out CRUD code generator. I'm used to SQL Server which insists that I prefix a parameter value with @ MySQL has no such rule and you can end up with something like
select *
from vwTestMAF
where TestMAFID = -1 or TestMAFID = TestMAFID;
where the TestMAFID is both the field name and the parameter name and the query naturally does not work.
Is there a naming convention for MySQL parameter (prefixing the parameter name with @ did not work either!)
Never underestimate the power of human stupidity
RAH
|
|
|
|
|
Perhaps qualifying the field names could help.
...where vwTestMAF.TestMAFID = -1 or vwTestMAF.TestMAFID = TestMAFID;
Cheers,
Mick
------------------------------------------------
It doesn't matter how often or hard you fall on your arse, eventually you'll roll over and land on your feet.
|
|
|
|
|
Qualifying the names did the trick, I was hoping there was a standard convention the mysql users would recognise.
|
|
|
|
|
The old MySQL method was to placehold with ? so and you had to add the values in the right order, currently MySQL uses @ and it works, not sure about MariaDB;
select *
from vwTestMAF
where TestMAFID = -1 or TestMAFID = ?;
|
|
|
|
|
What are some tricky/interesting SQL questions you were asked in interviews?
|
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
