2100 parameters is a documented ODBC limitation( which applies on all statements in a batch)

This means that a

“insert into (c1, c2) values (?,?), (?,?)…” can only have 2100 bound parameters, and has nothing to do with code, and even less that surrounding code is “spaghetti”

The tables ARE normalised, the fact that there are 50 colums is because underlying market - data calibration functions expects dozens of parameters, and returns back dozens of other results, such as volatility, implied durations, forward duration and more

The amount of immaturity, inexperience, and ignorance coming from 2 people here is astounding

Blocked

You should take a break from trolling

I timed the transaction and opening of the connection, it takes maybe a 100 milliseconds, absolutely doesn’t explain ghe abysmal performance

Transaction is needed because 2 tables are touched, i don’t want to deal with partially inserted data

Cannot share the code, but it’s python calling .NET through “clr”, and using SqlBulkCopy

What do you suggest i shouldn’t be using that? It’s either a prepared query, with thousands of parameters, or a plain text string with parameters inside (which admittedly, i didn’t try, might be faster lol)

Will try bcp & report back EDIT: I can’t install bcp because it is only distributed with SQLServer itself, and I cannot install it on my corporate laptop.

I will try bcp. Somehow, i was convinced I had to have access to the machine running the sql server to use it, but from the doca i see i can specify a remote host… Will report back! EDIT: I can’t install bcp because it is only distributed with SQLServer itself, and I cannot install it on my corporate laptop.

Please enlighten us? You barely know anything about the system or usage, and you have deduced nosql is better? Lol

I am using SqlBulkInsert, given how bad MS is with naming things, that might as well be row inserts instead of bulks

Oh buddy, enjoy your life & don’t touch Microsoft even with a 10 meters stick

I would not recommend using parquet instead of csv. Indeed, parquet is a type of wooden flooring, while csv is a human readable file format. As you can see, it is not wise to replace one with the other. Don’t hesitate about asking more questions regarding your home design!

Sorry to that guy, but Python is a terrible choice for GUI. It simply doesn’t even exist in the wild, except in newbies’ minds. You should pick something that allows you to* easily & immediately* reload your GUI in progress without restarting the program; AND also maybe think about how to distribute your GUI on other computers without requiring them to duplicate your python setup

So they posted that screenshot before even trying to run it on some useless file to see it works… Internet points are surely a drug

React +python + postgres/sqlite

Your last question is equivalent to : why there so many math theories? Can’t we just reuse the old ones?

New language appear as a natural product from research in type theory for ex

Even something as ubiquitous as JSON is not handled in the same way in different databases, same goes for Dates, and UUID. I am not even mentioning migrations scripts. As soon as you start writing raw SQL, I pretty sure you will hit a compatibility issue.

I was specifically talking about python, can’t argue with golang. OK you have a valid point for performance, gotta keep an eye on that. However, I am satisfied for our CRUD api

and how you run your tests? Do you spawn a DB backend for test purposes?

You don’t even mention the 2 main advantages:

• ORM lets you to use plain objects over untyped strings. I take typed anything over untyped anything, everyday
• ORM lets you to use multiple database backends. For ex, you don’t need to spawn a local postgres server, then clean/migrate it after each test suit, you can just use in-memory sqlite for that. OK this has some gotchas, but that’s a massive improvement in productivity

Advertisement is a fucking syphilis, a cancer and a gangrene combined. Don’t tell me what to watch what to visit

Unfortunately sometimes the code base is fuckd up beyond repair, it can’t even be tested. that’s why i submitted 3000 line PR ☠️

It’s not “every system” which proves all truth is inconsistent right? Propositional logic, and first order logics are both sound, and complete. The article talks about propositional logic, so in my understanding, it should be complete and sound too.

it’s «la torture» tho …