Search DaniWeb - large

Question Answering with YouTube Videos Using RAG in LangChain 6 Days Ago by usmanmalik57 … the vector databases and execute queries on large language models to retrieve information about YouTube ….html) vector index for efficient similarity search in large datasets. The following script installs these modules and … Splitting and Embedding YouTube Video Documents To handle large documents and prepare them for retrieval, we split… Re: sequential file save read option button 2 Days Ago by rproffitt …, you see the issue? 3. VB6, while I coded very large projects long ago, "It's Dead Jim." That… Re: Which programming language is best Ludo game development? 3 Days Ago by kishanrg When it comes to developing a Ludo game, the choice of programming language largely depends on your familiarity with the language and the platforms you intend to target. However, some commonly used languages for game development, including Ludo games, are C++, C#, Java, JavaScript, and Python. Ultimately, the "best" programming … Re: Which programming language is best Ludo game development? 3 Days Ago by polles i would choose JavaScript Using Natural Language to Query SQL Databases with Python LangChain Module 1 Week Ago by usmanmalik57 The advent of large language models (LLM) has replaced complex scripts with natural language … queries on various databases. To do so, we need a large language model (LLM) and database objects. The following script imports… Re: Improve HAVING BY performance 2 Weeks Ago by Dani … Google will spend in crawling the site. With sites as large as DaniWeb, it's an uphill battle having enough crawl… How to Optimize RecyclerView performance by implementing the ViewHolder 2 Weeks Ago by Mikekelvin … findViewById() in onBindViewHolder() can lead to performance issues, especially with large datasets. Implementing this pattern significantly enhances app responsiveness and user… 'Prepare for the Earliest Possible AGI Deployment Scenario' 2 Weeks Ago by Johannes C. … innovation while also failing to protect individuals and society at large. ## 6. In your opinion, will AI have a net positive… Re: DaniWeb Auto Answer A.I. feature 1 Week Ago by toneewa I have yet to try it or find it's limitations. Trying to free up some space. Those were the minimum requirements, plus 16GB of RAM and ~100GB free space. I also don't know how large a dataset for DaniWeb would be. Will know more later. Re: Improve HAVING BY performance 2 Weeks Ago by Biiim I realise this has been marked as solved, but I wanted to make it known that the HAVING clause runs on the returned result set of your query, which as you say has no indexes on it as it is just a temporarily created result set - but has the benefit of allowing you do do some simple post-processing on the result set. (This is for MariaDB at least)… Re: Improve HAVING BY performance 2 Weeks Ago by Dani > SELECT sum(points) total FROM ... HAVING points > 10 I don't have experience with MariaDB, but in MySQL, something like that will work as long as I do `SELECT sum(points) AS total FROM ... HAVING total > 10`. Is that what you were getting at? As far as what I was trying to accomplish that provoked this question, I was working on a … Re: Improve HAVING BY performance 2 Weeks Ago by Reverend Jim Was it worth all that for 50ms? Re: Improve HAVING BY performance 2 Weeks Ago by Dani In exchange for less than a day's worth of work? Of course!!!!! I've spent a *lot* longer to shave off a *lot* less. https://www.conductor.com/academy/page-speed-resources/faq/amazon-page-speed-study/ Re: Improve HAVING BY performance 2 Weeks Ago by Dani Now as far as whether going down that rabbit hole that day was worth the cost of losing AndreRet, then I'd have to give a resounding no. Re: Improve HAVING BY performance 2 Weeks Ago by Reverend Jim I have to admit that 95% of my work from 1995 to 2008 was back end stuff where I didn't have to worry about stuff like that. Digital plumbing and monitoring. The other 5% was single user apps. Not counting the 20% which was pointless meetings. So if you don't mind explaining, I'm curious as to why 50ms would even be noticible. I'm not asking just … Re: Improve HAVING BY performance 2 Weeks Ago by Dani I'm too exhausted for an in depth explanation right now but 90% of web development is optimizing for performance. The average DaniWeb page takes anywhere from 80ms up to 250ms to load the HTML (when dealing with low network latency), depending on the type of page, so shaving 50ms off of that is a huge win. Re: Improve HAVING BY performance 2 Weeks Ago by Dani Here are some articles that can explain it in greater depth: * https://web.dev/learn/performance/why-speed-matters * https://developer.mozilla.org/en-US/docs/Learn/Performance * https://web.dev/explore/fast The HTML page must be downloaded in its entirety before the web browser can begin loading anything else (CSS, Javascript, images, etc.)… Re: Improve HAVING BY performance 2 Weeks Ago by Reverend Jim I suppose I am looking at it in terms of practicality. I suppose there might be several reasons to optimize: 1. It saves resources on the hosting platform 2. It improves the user experience 3. It provides personl satisfaction Point #1 would save you money if the savings were significant. Point #2 would apply if the improvement was … Re: Improve HAVING BY performance 2 Weeks Ago by Biiim > I don't have experience with MariaDB, but in MySQL, something like that will work as long as I do SELECT sum(points) AS total FROM ... HAVING total > 10. Is that what you were getting at? Kind of, MariaDB is a fork of MySQL from around 2009 or something like that, MySQL 5.* and the creator continued developing MariaDB and Oracle took … Re: Improve HAVING BY performance 2 Weeks Ago by Dani > I know that in my experience, OR's are very bad for speed you can get away with a few but they can get very bad when they stop the whole query making use of one of the main indexes, you can actually speed it up by moving the or's into the HAVING usually. Thank you for that tip! I never thought of that, but it totally makes sense!! > … Re: Improve HAVING BY performance 2 Weeks Ago by toneewa I'm a little late to the party, however, I want to share my experience learning MySQL in the past day. I setup a server, a database, and wrote a C++ program to connect to it. It measures the times for 3 SELECTs. The whole product list, using HAVING, and WHERE. I also tested reversing the orders. Query execution time: 0.0002336 seconds … Re: Improve HAVING BY performance 2 Weeks Ago by Dani But you're not comparing apples to apples. Your WHERE query and your HAVING query perform different calculations and do different things. In one, you're plucking out all the rows with a price greater than $4, and then calculating an average price for each product. In the other, you're plucking out *all* rows, calculating an average price for each … Re: Improve HAVING BY performance 2 Weeks Ago by toneewa Correct. It wasn't about displaying the results, but to measure the different clauses. I'm not impressed by only 95 INSERTs/sec, and a maximum write speed of 175 KB/s for importing data. Increasing to 50K shows WHERE to be faster. 50K: WHERE Query execution time: 0.0599129 seconds HAVING Query execution time: 0.0621748 … Re: Improve HAVING BY performance 2 Weeks Ago by Dani I think you might be missing my point. If you’re fetching different data, there’s no way of saying whether where or having is faster. You would need to write queries that use each, but retrieve the same data, to see which is faster for a use case. Even then, it totally depends on the data in the database itself. The same query can be fast for some … Re: Improve HAVING BY performance 2 Weeks Ago by toneewa I know when you don't use aggregate calculations use WHERE. Producing the same results can be done. I added another test with MAX(Price). With a database over 305K rows, 3 columns, MySQL Workbench is unstable importing. Took over 2 hours. WHERE is faster, and should be used, when no functions are needed. WHERE Query execution time: 0.… Re: Improve HAVING BY performance 1 Week Ago by Biiim > INSERT INTO electronics.products(ProductID, ProductName, Price) VALUES ('1','capacitors', 2.50), ('2','resistors', 4.50), ('3','rectifiers', 7.50), ('4','diodes', 10.00), ('5','ICs', 25.00), ... ('50000','...', ...); I don't see any mention of an index on it & your benchmark indicates you don't have one: ALTER TABLE `… Re: Improve HAVING BY performance 1 Week Ago by toneewa I added your mentioned alter table index. Took 4.375 secs in MySQL Workbench. It did speed up the results. I'll have to try another method of importing to see if I can improve this. I also ommitted the overhead of converting variables for display output measurements, because they were included in the C++ times. If we were to compare the two, it as … Choosing the Right Framework: Comparing Pros and Cons 2 Months Ago by riyajohnson70 …, which make it easier to build and maintain large-scale applications. Additionally, React's virtual DOM implementation… features. Angular provides a complete solution for building large-scale applications and supports two-way data binding,…and performance can be an issue for applications with large data sets. Vue is a lightweight framework with… Retrieval Augmented Generation (RAG) with Google Gemma From HuggingFace 1 Month Ago by usmanmalik57 … will explain how you can improve performance of a pretrained large language model (LLM) using retrieval augmented generation (RAG) …huggingface.co/thenlper/gte-large) from HuggingFace. ``` embedding_model = SentenceTransformer("thenlper/gte-large") model_path = "thenlper/gte-large" embeddings = HuggingFaceEmbeddings… 7 NLP Tasks to Perform for Free in Python with Mistral 7b LLM 1 Month Ago by usmanmalik57 … field of Natural Language Processing (NLP), open-source large language models (LLMs) are becoming increasingly popular as… API incurs charges. This is where open-source Large Language Models (LLMs) like Mistral 7b become game…input paragraph. ``` paragraph = """ A large language model (LLM) is a language model notable for …