summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2010-09-24Add note about mean syncing delayrelease_2010-09-24Dan McGee1-1/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Give more information about mirror check runs and frequencyDan McGee3-19/+38
Show how many times the check has ran in the last 24 hours, as well as the average interval between checks. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Mirror status query refinementsDan McGee1-4/+4
Only show errors for active and public mirrors, and collapse two filter calls into just one for our normal status query. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Fix news permission checking in templatesDan McGee2-6/+6
We were still looking at the permissions on the main application; these need to be updated to point at the news application instead. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Update BBS and bugs links to use HTTPSDan McGee7-28/+28
Since we only do HTTPS now on these services, no point in sending someone through a useless redirect. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Get secure/unsecure checking actually workingDan McGee3-5/+19
We need a bit more, like actually having something relevant in the RequestContext object, in order for this to all work. Instead of putting the full request in just populate a 'secure' key with a boolean value indicating whether the request is secure. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Update newsletter/magazine linkDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Switch mirror status delay display to average delayrelease_2010-09-22Dan McGee3-11/+27
This takes a bit more work to compute, but since we cache all of this anyway it isn't too big of deal. Using average delay instead of last delay will be a bit more fair on mirrors that have odd syncing schedules, as well as exposing those that only sync once a day. Also fix an issue that will arise with cutoff_time being calculated once, and adjust mirror score to treat hours delay as a float rather than an integer. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow generated mirrorlist to take status info into accountDan McGee4-11/+42
By using the mirror score we calculate, we can sort the mirrors in the generated mirrorlist for people. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow caching of mirror status infoDan McGee2-30/+48
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Fix self-closing anchor links for ChromeDan McGee1-3/+3
Apparently it can't parse a very normal looking <a/> because they forgot one of their original purposes doesn't require a body. Awesome. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Prevent 500 if no mirror checks have ranrelease_2010-09-21Dan McGee1-1/+4
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Merge branch 'mirror-check'Dan McGee12-5/+452
2010-09-21Add link to mirror status toolDan McGee2-4/+11
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add ordering, sorting, and a lot more info to mirror status pageDan McGee3-7/+60
This should get this to the point where it is releasable to the general public for their use and pleasure. Still not sure on how often the check should be run, and we probably want to incorporate this mined data into some other things like the mirror list generator. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Small updates to mirrorcheck commandDan McGee1-3/+5
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow serving jQuery via HTTPS if secure request detectedDan McGee1-1/+6
Handles the concerns in FS#19045. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add debugger when having to parse lastsync fileDan McGee1-0/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add mirror status viewDan McGee6-0/+148
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add 'mirrorcheck' commandDan McGee3-0/+149
This does the actual work of going out and checking the mirror status. In short, it polls every active mirror URL for the 'lastsync' file and then records the appropriate details. These include the contents of that file, how long the total time to retrieve took, and any errors encountered. In order to finish up a bit faster, we spawn several threads to do the actual work. This parallelization allows the whole check process to take around 30 seconds rather than several minutes. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Rename generate mirrorlist viewDan McGee2-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add new MirrorLog model and associated migrationDan McGee2-0/+86
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Auto-populate slug on news item creationDan McGee2-3/+17
And make sure it is unique through a few queries and some magic. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Update news views to use slug instead of IDDan McGee5-18/+25
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add migrations to populate the news slug and make it non-nullDan McGee3-1/+145
These should get us all set to have more useful URLs for the news items. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add news slug fieldDan McGee2-0/+67
Initially, this needs to allow null so that we can add in slugs for all of our old news items. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-20Update news permission required stringrelease_2010-09-20Dan McGee1-4/+4
When moving the news model and updating the content type, I forgot to update these strings to reflect the new permission name. Whoops. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-20Fix package differences pkgrel comparisonDan McGee1-3/+4
Using the right index in the array might help; we were comparing pkgver again and not pkgrel at all. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-16Remove some leftover print statementsDan McGee2-3/+0
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Spruce up news admin viewDan McGee2-4/+4
Add last modified date as a column, and fix up some other small display, sorting, and ordering issues. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Ensure consistent date formatting everywhererelease_2010-09-14Dan McGee8-7/+10
Set up a default DATE_FORMAT in settings.py and use it everywhere we do the '|date' template filter rather than hardcoding the value in the template. This also fixes a regression with news date/time now that we changed the field to store both date and time. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Re-enable etagsDan McGee1-2/+0
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Improve request handling for feeds that haven't changedDan McGee1-0/+37
By using the condition decorator (in a slightly odd way because these are class-based views), we can cut down a lot on the response time for returning 304 status code for feeds that haven't changed. The decorator means we no longer have to completely render the view to see if we can return a 304 status code. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Reorder middleware to be more inline with Django defaultsDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Add last modified date to newsDan McGee2-1/+76
This will come in handy when determining whether resources are out of date, such as our news RSS feed. Also bump the Date fields to DateTime fields for sake of sorting and if we have more than one news item on the same date. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12Bump requirements for Django security releaseDan McGee2-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12reporead: revamp database parsing codeDan McGee1-93/+64
This needed a little sprucing up as it has grown quite organically over the life of this script. Make things a bit more pythonic through the use of iterators rather than collection indexing, and try to generalize the special cases of things a bit. Also catch encoding problems early and fail gracefully rather than blow up the entire package parser. A failed decode of a file should cause us to just skip it rather than stop the entire parser. Worst case, this leaves that package out of the web interface. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12Check for correct permission when creating usersrelease_2010-09-12Dan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10Restore flagged package count by maintainer in dashboardDan McGee3-12/+44
We need to do a little dropping into SQL to accomplish this, but it isn't all that bad to actually do and we can do the whole thing in one query. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10reporead: allow traceback on USR1 signal as wellDan McGee1-2/+3
When I have caught reporead behaving badly on the production box, I haven't been able to successfully get a traceback without killing the process. Hopefully using a different signal will allow me to actually capture some data. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10Remove SomethingFishyExceptionDan McGee1-7/+2
Just use a plain Exception instead since we don't get any added value by subclassing. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Improve todo list view pageDan McGee2-6/+22
Add total package count and incomplete package count columns. Also reduce the number of total queries by killing the query per row that was happening before. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Remove redundant text from groups package count columnDan McGee1-12/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09After moving models, update content type tablerelease_2010-09-09Dan McGee1-0/+169
The one thing that people forget to mention when moving models from one Django app to another. I was fooled here. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Hide multilib by defaultDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Update arch fixture with new columnDan McGee1-0/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Use arch.agnostic flag everywhereDan McGee3-10/+17
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Add metadata to Arch tableDan McGee4-1/+313
Add a column flagging whether this architecture is agnostic (e.g. 'any') or not. This will remove the hardcoded name checks we have all over the place and replace it with a boolean. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Fix download links to work with package poolsDan McGee1-1/+5
With package pooling we don't put things in the '/any/' folder anymore under each repository; they only show up in the actual architectures. Use a 'real' architecture as part of the download link to rectify this. Fixes FS#20779. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Add links to arch differences pageDan McGee2-1/+4
Hopefully finishes FS#20416. Signed-off-by: Dan McGee <dan@archlinux.org>