Search DaniWeb - dataframe

OpenAI o3 vs Anthropic Claude 4 for Text Classification & Summarization 4 Days Ago by usmanmalik57 …!= '') & (dataset['text'].str.strip() != '')] # Filter the DataFrame for each sentiment neutral_df = dataset[dataset['airline_sentiment'] == 'neutral'] positive_df = … results = summarize_articles(client, model, dataset, max_tokens) results_df = pd.DataFrame(results) mean_values = results_df[["rouge1", "rouge2", … Evaluating OpenAI GPT 4.1 for Text Summarization and Classification Tasks 2 Months Ago by usmanmalik57 …() != '') & (dataset['text'].str.strip() != '')] # Filter the DataFrame for each sentiment neutral_df = dataset[dataset['airline_sentiment'] == 'neutral'] positive_df = dataset…= negative_df.sample(n=33) # Concatenate the samples into one DataFrame dataset = pd.concat([neutral_sample, positive_sample, negative_sample]) # Reset index … Re: Question/Answering over SQL Data Using LangGraph Framework 2 Months Ago by Pelorus_1 Through its combination of natural language processing and structured query generation, LangGraph makes interfacing with databases and extracting insights over SQL data easier than ever. Re: Converting integer dataframe to string 11 Years Ago by Taruna_1 Dataframe sample is given below: Item Class Cd 57 57 57 57 57 57 57 57 57 57 57 18 I am reading it as df = pd.read_csv("C:\\Desktop\\TEST.csv") How to vectorize and speed-up double for-loop for pandas dataframe when doi 2 Years Ago by Al_628 …1, 4, 2, 2, 2] } df_test = pd.DataFrame(d_test) I want to identify similar names in `name` column… 7 Computation runs for 210 seconds for dataframe with 1 million rows where in average … 1, 4, 2, 2, 2] } df_test = pd.DataFrame(d_test) # pip install thefuzz from thefuzz import fuzz df_test = … Adding Row to Pandas Dataframe 13 Years Ago by Niner710 I am interested in using a PanDas dataframe to manipulate data. Can anyone tell me how to append **b ** into **df** so that I get **7 8 9 10 5 6 7 8** as my **df** dataframe. from pandas import * a = [ [7,8,9,10], ] b = [ [5,6,7,8],] df = DataFrame(a) df.append(b) ???????? Converting integer dataframe to string 11 Years Ago by Taruna_1 I have an integer dataframe and in my code I am doing some length calculation( which can be only perfomred on string), therefore I need to convert my dataframe to String. I have tried using str(), its not helping me, it would be helpful if you could suggest something. How to add a new column to a hierarchical dataframe grouped by groupby 11 Years Ago by glez_b … averages of Temperature, Moisture and Sum of Precipitation. My monthly dataframe has the following column: data Fecha Hora DirViento MagViento Temperatura…(2) Now using "pandas" and we indexed the dataframe and grouped index=data.set_index(['Fecha','Hora'],inplace=True) grouped… python custom class return dataframe 10 Years Ago by moone009 ….2 class ReturnDataFrame: import pandas as pd from pandas import DataFrame def FileName(self,FileName): self.name=name EFile = pd.…import * X = returnDataFrame() X.FileName('F:/Python/Week05052013.csv') WeeklyFile = DataFrame() WeeklyFile = WeeklyFile.append(X.returnFile()) Re: python custom class return dataframe 10 Years Ago by moone009 …): return EFile **Execute code below:** import pandas from pandas import DataFrame import ReturnDataFrame from ReturnDataFrame import * X = returnDataFrame() X.FileName('F… Re: Convert Pandas DataFrame to List 12 Years Ago by Niner710 This is my dataFrame. In [63]: pandasDF Out [63]: LogBlk Page BayFail 0 0 …, 1, 4, 5, 6, 8, 9, 12, 13, 14] My dataframe is pandasDF and it gives me the output above. What… Re: Converting integer dataframe to string 11 Years Ago by vegaseat Give us an example of a dataframe. Re: Converting integer dataframe to string 11 Years Ago by Gribouillis Apparently, you are using pandas DataFrame instances. The api reference for these objects contains [conversion methods](http://pandas.pydata.org/pandas-docs/dev/api.html#id12). I would try s = df.to_string() Re: python custom class return dataframe 10 Years Ago by Gribouillis … == '__main__': X = returnDataFrame() X.FileName('F:/Python/Week05052013.csv') WeeklyFile = DataFrame() WeeklyFile = WeeklyFile.append(X.returnFile()) Re: python custom class return dataframe 10 Years Ago by moone009 Got it working. When I write the actuall class code in the terminal I was not running into any issues. However when I was importing my class I was running into issues. I added the Import pandas and from pandas import DataFrame to the top of my returnDataFrame.py and then it worked without any issues. Convert Pandas DataFrame to List 12 Years Ago by Niner710 I want to convert a Pandas DataFrame series to a List. In [63]: bayFails Out[64]: 0 [0, 1, 4, 5, 6, 8, 9, 12, 13, 14] In [63]: type(bayFails) Out[64]: <class 'pandas.core.series.Series'> Can someone show me how to convert bayFails into a list? How to find the datatype of the dataframe 11 Years Ago by Taruna_1 …, I want to identify the datatypes of the te entire dataframe and group it as String, Number and Date. Required Output… Pandas.DataFrame.Read_csv 9 Years Ago by Abdulkabir_1 …") row = next(df.iterrows())[1] print(row['x']) error: dataframe is not defined. I have a cvs file with 5… Strata based sampling from database into a dataframe 2 Years Ago by likithsai How can I sample data from a database strata by date. Table a, partitioned by date. I need to do a sampling of the table with more latest record and less older record and move it into a panda dataframe. Re: Converting integer dataframe to string 11 Years Ago by Taruna_1 Thanks for the prompt reply. I will rather talk about my issue in detail. My code is : df1 = pd.read_csv("C:\\Desktop\\TEST.csv") df=df1.to_string() mylist=df["Item Class Cd"] max_len=len(max(mylist, key=len)) min_len=len(min(mylist, key=len)) Item Class Cd is integer, so to perform len function on it, this needs to be … Re: Converting integer dataframe to string 11 Years Ago by Gribouillis After `df=df1.to_string()`, df is a str object (a sequence of bytes). You can use `df[11]` which gives you the 12th character in the sequence, but not `df["Item Class Cd"]`. Re: Converting integer dataframe to string 11 Years Ago by Taruna_1 So how do I resolve my problem in that case Re: python custom class return dataframe 10 Years Ago by Gribouillis Here is a short explanation about variable visibility varA = "foo" # a global variable class Bar: # Bar is another global variable varB = "baz" # a class variable def method(self, arg): # self and arg are local variables varC = "qux" # a local variable self.name = "aname&… Re: Convert Pandas DataFrame to List 12 Years Ago by woooee It appears that bayFails is a class instance ><class 'pandas.core.series.Series'> and so can not be converted to a list. You will have to access the data within the class. Since we have no idea were bayFails comes from, the only advice would be to read the Pandas docs since extracting data would be rountinely done by many programmers (I… Re: Convert Pandas DataFrame to List 12 Years Ago by TrustyTony What your request seems to boil to is page = 128 block = 0 print sorted(set(range(16)) - set(pandasDF[pandasDF['Page'] == page]['LogBlk'] == block]['BayFail'])) But I have no means to check it. Re: Convert Pandas DataFrame to List 12 Years Ago by Niner710 Stupid question. But what's the easiest way to do these lines of code all on one line? page = 128 block = 0 pandas1 = pandasDF[pandasDF['Page'] == page] pandas2 = pandas1[pandas1['LogBlk']== block] bayFails = pandas2['BayFail'to do this? This doesn't work for me for some reason. pandasDF[pandasDF['Page'] == page][… Re: Convert Pandas DataFrame to List 12 Years Ago by dashing.adamhughes Pandas has a very good mailing list, perhaps you should consider joining it and posting this question there. Re: Pandas.DataFrame.Read_csv 9 Years Ago by Gribouillis You could perhaps start with `groupby` objects: grouped = df.groupby(['Date','Time']) for name, group in grouped: print(name) print(group) see http://pandas.pydata.org/pandas-docs/stable/groupby.html Re: Pandas.DataFrame.Read_csv 9 Years Ago by Abdulkabir_1 Hi Gribouillis, I have included your code it is still giving error import pandas as pd import datetime import pandas.io.data from pandas_datareader import data, wb df = pd.read_csv('testfile.csv') grouped = df.groupby(['Date','Time')] for name, group in grouped: print (name) print(group)… Re: Pandas.DataFrame.Read_csv 9 Years Ago by Abdulkabir_1 Hi Gribouillis, Thank you so much. I love you bro! You are the best. import pandas as pd import datetime import pandas.io.data from pandas_datareader import data, wb df = pd.read_csv('testfile.csv') grouped = df.groupby(['Date','Time']) for name, group in grouped: print (name) print(group) …