Commit Graph

103 Commits

Author SHA1 Message Date
Aníbal Limón
066b17adb3 rrs/tools/rrs_upstream_email.py: Update message to point recipe file
instead of deprecated upstream tracking file.

Since upstream_tracking.inc file is deprecated because now every recipe
has it's own upstream information then update email message according it.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2016-01-06 10:25:24 -06:00
Aníbal Limón
baf1798be1 rrs/recipes: Add support for persist search and filters.
Now when search something the URL is modified and you can
share the URL for access to the data.

[YOCTO #7809]

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-12-01 18:02:59 -06:00
Aníbal Limón
45499f50c2 rrs/urls.py: Disable permanent (301) redirection on main view.
Don't redirect permanently in main view because the first URL needs
to point to the current release, so use permanent = False to return
a 302..

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-11-05 12:38:23 -06:00
Belen Barros Pena
214d70d4aa Update tool URL in status email
The status email sent to the Yocto Project mailing
list by the Recipe Reporting Tool still shows the
old URL (http://packages.yoctoproject.org).

This patch changes it to the new URL:

http://recipes.yoctoproject.org

Signed-off-by: Belen Barros Pena <belen.barros.pena@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-10-23 09:33:02 -05:00
Aníbal Limón
1b78ec6132 rrs_upstream_history.py: Fix use regexes in packages
Make difference when handling suffixes or preffixes like 'nativesdk-'
when try to use regexes in packages that have suffixes like '-crosssdk'
it can contain the arch into it like binutils-crosssdk-x86_64.

Use split method in suffixes and replace method into preffixes, this
fixes issues with suffixes containing archs at end.

[YOCTO #8102]

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-09-22 18:36:23 -05:00
Mariano Lopez
443779d02b rrs/views: Fix mismatch in summary and recipe list
This fixes the issue with the mismatch in the
statistics bar and the recipe list. The mismatch
is caused by the gcc-source recipe, because every
version of the recipe is counted in Upstream History
but not in Recipe Upgrade.

Also added the TODO.rrs to track bugs and issues with
rrs.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-08-28 13:24:39 -05:00
Mariano Lopez
1473c6264d rrs/base_toplevel.html: Navbar redesign
This provides changes in the front end for the
navbar, now it shows the percentage of recipes
up-to-date, not update, unknown and can't be
updated along with the number of recipes.

This also moves the update percentage to the
end and adds clarity to what it means.

This also moves the export list button the the
top bar.

[YOCTO #8020]

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-08-17 14:59:56 -05:00
Mariano Lopez
865266ca7f rrs/views.py: Added percentages for navbar
This adds the percentage for all the recipes types
(up-to-date, not updated, unknown, can't be updated)
so it can be displayed in the navbar.

This also adds the number of the recipes not updated
at the begining of the period and number of recipes
updated in the period.

The changes in the frontend are still missing, this
just adds the functionality.

[YOCTO #8020]

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-08-17 14:59:26 -05:00
Aníbal Limón
d882336f7e rrs_upstream_history.py: Use regexes in SPECIAL_PKGSUFFIX packages
When SPECIAL_PKGSUFFIX packages don't have regexes use it from package
without SPECIAL_PKGSUFFIX.

[YOCTO #8102]

For example: python-native use regex from python if don't have one.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-08-10 14:35:20 -05:00
Mariano Lopez
e1881ed0a3 rrs-additional.css: Added min-width to last update column
This adds the min-width for the last updated column
to the css.

[YOCTO #8018]

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
2015-07-29 10:20:42 -05:00
Mariano Lopez
9b1c29a9ff views.py: Show last updated date for all recipes
This changes the behavior of the last update column
and show the date for all the recipes, including the
up to date recipes.

[YOCTO #8018]

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
2015-07-29 10:20:28 -05:00
Aníbal Limón
7c09b47907 rrs/tools: UpstreamHistory only load current recipe files.
Don't load all recipes avaiable in layer because was previous
filtered to have the last version.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 19:25:57 -05:00
Aníbal Limón
c314485b01 rrs/tools: get_recipe_pv_without_srcrev add support for discard prefixes
Avoid version prefixes like v|r into all versions.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 18:36:53 -05:00
Aníbal Limón
ad5ccc214f rrs: Fix last updated.
Don't conditional last updated to upstream status.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 18:22:14 -05:00
Aníbal Limón
d8b6e988de rrs/tools: Add daily_run.sh script for provide updates.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 17:38:16 -05:00
Aníbal Limón
c21f32b0ea rrs/tools/rrs_upgrade_history.py: Don't take into account git recipes
without versioning.

Don't detect upgrade in git recipes that don't have versioning only
PV=git.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 16:41:46 -05:00
Aníbal Limón
87bef7fed5 rrs/views.py: RecipeListView always use recipes from history.
If recipe don't exist in history means that don't need to be displayed.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 16:23:00 -05:00
Mariano Lopez
44416d5e50 models.py: Code cleanup
Cleaned up the class Raw to have better readability.
Also added docstring to methods in this class.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 16:17:58 -05:00
Mariano Lopez
db9a8ba2cf views.py: Changed date format to iso
Changed the day format to iso. Also, the outdated
field in the recipes views was changed from days
to the date the recipe was last updated.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 16:17:40 -05:00
Mariano Lopez
823ee8c3d8 views.py: Changed the behavior of percentage done
This changes the percetage done from recipes up to date
in the period to percentage of not updated recipes that
were updated in the period.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 16:17:27 -05:00
Mariano Lopez
50d821aab4 models.py: Added Raw SQL for percentage updated
This adds SQL queries that will be used for the
percentage of recipes updated in a period.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 16:17:19 -05:00
Mariano Lopez
9a134fc367 views.py: Fix current up to date percentage
There was an issue where the current up to date was always
using the latest upstream version to get the percentage.
This uses the upstream version in the period displayed.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
2015-07-14 16:17:09 -05:00
Mariano Lopez
d4dd443421 views.py: Fix version in current milestone
Fixed the version displayed in current milestone.
Before the data was obtained from recipe upgrad table
and this allows to fetch the data from the recipe table.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
2015-07-14 16:16:45 -05:00
Mariano Lopez
327d3a29b7 views.py: Add how long a recipe hasn't been updated
This add a tooltip in the upstream status field that
show how long the recipe hasn't been updated.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 15:38:16 -05:00
Mariano Lopez
4b992d81d3 rrs/views.py: Changed ORM to raw SQL calls
Allow to use the new raw SQL call to get better performance in the
web page. Also removed SQL queries inside loops.
This is only for two views: recipes and maintainers

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 15:36:20 -05:00
Mariano Lopez
0b1a4c8a33 rrs/models.py: Added raw SQL calls
The raw calls are going to be used instead of Django's ORM.
This improves the performance of the webpage.

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 15:34:52 -05:00
Aníbal Limón
4f5d5a7784 rrs/tools/rrs_maintainer_history.py: Set new recipes to No maintainer if don't have
When add new recipes sometimes don't have maintainer defined causing
errors on frontend when search for one.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
34c38fbb2e rrs/tools: Add rrs_distros script.
This script updates the information about recipes in other distros.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
4b5bdfb723 rrs/tools/rrs_upstream_history.py: Remove unneeded histroy save at end.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
3a050f47de rrs/tools: Convert unicode strings from Django models to strings.
bb.cache.Cache.loadDatafull() expects an filepath in asciii, if not
is provided it fails with character mapping error.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
3c60ef2f19 rrs/tools: Remove call to tinfoil shutdown method.
Tinfoil shutdown was not accepted as patch into bitbake because
this is a simple solution to a big problem.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
fab6365756 rrs/tools/rrs_upstream_history.py: Add recipe upstream script.
This script generates upstream version information and recipe status.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
a261ae3148 rrs/views.py: RecipeList always use recipe from Recipe upgrades.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Mariano Lopez
7dca9b23e3 views.py: Added validation in recipe detail
Added the validation for the maintainer in the
recipe detail view. Also added a check if the
recipe exists.

[YOCTO #7904]

Signed-off-by: Mariano Lopez <mariano.lopez@linux.intel.com>
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
b29c353cfc rrs/tools/rrs_unique_recipes.py: Now only filter same pn recipes.
Don't remove native, cross, crossinitial and sdk recipes now only
keep major version of recipe based by pn.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
5df636a9c3 rrs/tools/rrs_upgrade_history.py: WORKAROUND Run recipe parse as different proccess.
When runs recipe parse with different revisions in same process it
generates errors due to cooker parser uses global data cache's.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
cbdfaa0e39 rrs/tools/common.py: Add import of FetchError and display parse errors
Import of FetchError when try to expand PV somethings requires to have
SRCREV/SRCPV causing an FetcherError.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
488a2351ad rrs/tools.py: Create standalone get_recipe_pv_without_srcpv function.
Copied get_recipe_pv_without_srcpv from oe-core/recipeutils library
to avoid import errors caused by have imported twice oe-core from poky
and from tinfoil.

rrs/tools/rrs_upgrade_history.py: Update to use get_recipe_pv_without_srcpv
from common.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
d75b296349 rrs/tools/rrs_unique_recipes.py: Also filter -source recipes.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
2404b45c5e rrs/tools: Change to use get_logger from common.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
a62ab520c5 rrs/tools/rrs_upgrade_history.py: Only run upgrade detection when detect recipe files in commit.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
873429a052 rrs/tools/common.py: Handle exception when load_recipes caused by expand PV variable.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
8a5bbea99f rrs/tools/rrs_unique_recipes.py: Change to use get_logger from common.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
0aba352c22 rrs/tools/common.py: Add get_logger function.
get_logger function creates a stream logger and a rotate
file logger to store logs.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
d6f1a1e061 rrs/tools/rrs_upgrade_history.py: Improve version detection.
Use load_recipes from common instead of parse PV by hand.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
b98e1ff8f0 rrs/tools/common.py: Add load_recipes function.
load_recipes function setup tinfoil and parses recipe for given
directory.

Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
2e33ec6e26 rrs/tools/rrs_unique_recipes.py: Remove wrong info at top comment.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
161d30b3b7 rrs/tools: Add script for send email to maintainers.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
2607f7763b rrs/tools/rrs_: Reorder imports.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00
Aníbal Limón
72b0029672 rrs/tools/rrs_upgrade_history.py: Add script for update the recipe upgrades history.
Signed-off-by: Aníbal Limón <anibal.limon@linux.intel.com>
2015-07-14 10:51:41 -05:00