pandas/groupby-first-skips-missing
| Rule | groupby-first-skips-missing |
|---|---|
| Pack | pandas |
| Severity | warning |
| Fix | unsafe, with xpd check --fix --unsafe-fixes |
| Library versions | every version |
groupby(...).first() and last() take the first value that is not missing in each column, so one result row can mix values from different rows. Pass skipna=False when you want the whole first or last row.
first = df.groupby("region").first()first = df.groupby("region").first(skipna=False)What the rule reports
Section titled “What the rule reports”The rule reports df.groupby("k").first() and last(), which skip missing values per column, so one result row can mix values from different rows. The rule leaves df.groupby("k")["b"].last() alone, because one column can't mix rows.
How to fix it
Section titled “How to fix it”xpd check --fix --unsafe-fixes applies the fixes of this rule. Check the result, because an unsafe fix can change what the code does.
The unsafe fix writes first(skipna=False) and last(skipna=False), which change the result on purpose to the whole first or last row.
skipna=False keeps the missing values of the first row.
Message
Section titled “Message”xpd prints this message with the issue. A name that starts with $ stands for code from your file.
$M() takes the first value that is not missing in each column, so one result row can mix rows. Write $G.$M(skipna=False) for the whole first row.Browse the other rules of the pandas pack.