unlsitemaster / site_master Goto Github PK
View Code? Open in Web Editor NEWLicense: Other
License: Other
You ask the user to create a specifically named file on there server. It would be much easier if you gave them a file to download (clicking is easier than copy/paste).
I also suggest that a template verification file include some text about what the file is and who it's for:
This file {FILENAME}
belongs to {USER} {EMAIL}.
It's a verification key for SiteMaster.
I would also include some copy about if/when it is safe to delete the file.
If a site's base URL in webaudit starts with https, but the site contains links that are both http and https, only the https links are seen and the http links are ignored.
We had a request come in where it would be nice to see a page count on the My Sites page so you can easily compare the different sites
We would probably want to convert the panels on the My Site Page to a grid (/www/templates/html/SiteMaster/Core/Registry/Sites/All.tpl.php)
We would also need to use the getPageCount func from the site records (/src/SiteMaster/Core/Registry/Site.php)
Suggestions:
.site-list
.site-list .site
styles to .panel
Without some sort of textual context, I have no idea what kind of value I am selecting and what value I have selected.
This state page would keep a record of all events which caused mass 0 scores.
These scores are due to a outside service that are used/linked on a majority of pages. When these services go down it causes each page to get a bad score and leads to the site getting a 0.
These 0's would also prompt a notice in the email notification that says that the issue may be related to an outside service and to check the status page for details.
For 301 errors include the URL that the link should go to.
For all errors, include the link text to make it easier to find on the page.
$ php vendor/bin/phpunit --bootstrap init.php tests
PHPUnit 3.7.29 by Sebastian Bergmann.
....EEE.E............
Time: 649 ms, Memory: 4.50Mb
There were 4 errors:
1) SiteMaster\Core\Registry\QueryDBTest::getByUser
Argument 1 passed to SiteMaster\Core\Registry\Site\Member\Role::createRoleForSiteMember() must be an instance of SiteMaster\Core\Registry\Site\Role, boolean given, called in /var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php on line 50 and defined
/var/www/html/src/SiteMaster/Core/Registry/Site/Member/Role.php:38
/var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php:50
/var/www/html/src/SiteMaster/Core/DBTests/DBTestCase.php:49
/var/www/html/tests/SiteMaster/Core/Registry/QueryDBTest.php:95
/var/www/html/tests/SiteMaster/Core/Registry/QueryDBTest.php:14
2) SiteMaster\Core\Registry\QueryDBTest::getByURL
Argument 1 passed to SiteMaster\Core\Registry\Site\Member\Role::createRoleForSiteMember() must be an instance of SiteMaster\Core\Registry\Site\Role, boolean given, called in /var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php on line 50 and defined
/var/www/html/src/SiteMaster/Core/Registry/Site/Member/Role.php:38
/var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php:50
/var/www/html/src/SiteMaster/Core/DBTests/DBTestCase.php:49
/var/www/html/tests/SiteMaster/Core/Registry/QueryDBTest.php:95
/var/www/html/tests/SiteMaster/Core/Registry/QueryDBTest.php:50
3) SiteMaster\Core\Registry\QueryDBTest::getByAll
Argument 1 passed to SiteMaster\Core\Registry\Site\Member\Role::createRoleForSiteMember() must be an instance of SiteMaster\Core\Registry\Site\Role, boolean given, called in /var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php on line 50 and defined
/var/www/html/src/SiteMaster/Core/Registry/Site/Member/Role.php:38
/var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php:50
/var/www/html/src/SiteMaster/Core/DBTests/DBTestCase.php:49
/var/www/html/tests/SiteMaster/Core/Registry/QueryDBTest.php:95
/var/www/html/tests/SiteMaster/Core/Registry/QueryDBTest.php:73
4) SiteMaster\Core\Registry\RegistryDBTest::getClosestSite
Argument 1 passed to SiteMaster\Core\Registry\Site\Member\Role::createRoleForSiteMember() must be an instance of SiteMaster\Core\Registry\Site\Role, boolean given, called in /var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php on line 50 and defined
/var/www/html/src/SiteMaster/Core/Registry/Site/Member/Role.php:38
/var/www/html/src/SiteMaster/Core/DBTests/BaseTestDataInstaller.php:50
/var/www/html/src/SiteMaster/Core/DBTests/DBTestCase.php:49
/var/www/html/tests/SiteMaster/Core/Registry/RegistryDBTest.php:16
FAILURES!
Tests: 21, Assertions: 52, Errors: 4.
Anywhere it says Add\Edit
to Add/Edit
This would help identify pages that would not be displayed well when shared on twitter, facebook, or other social platforms.
Not sure if this is the right issue queue. I was able to authenticate via InCommon, but I've tried both the file and the metatag verification using the options provided by https://www.drupal.org/project/site_verify
https://www.colorado.edu/webcentral/sitemaster_v_a188be672e9dd34ee5b75b56e5709cc7.txt
The verification step always fails.
So submitting the form always fails.
https://github.com/UNLSiteMaster/site_master/blob/master/www/templates/html/SiteMaster/Core/Registry/Site/MembersForm.tpl.php should be edited to include something like
Should https://github.com/UNLSiteMaster/site_master/blob/master/composer.json#L28 be in "require-dev"?
https://getcomposer.org/doc/04-schema.md#require-dev
Making that change allows other developers to exclude that package from production builds as well as makes a distinction between which packages are needed for development of the project and which packages are needed to run the project.
This would be for sites AND overall system
How does the system use "Site Title" and "Support Email Address"?
Take this scenario
A website has a badly coded relative URL link, we keeps appending the link's path to the end of the url. It would look something like this: http://www.example.com/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/contact-us/co
SiteMaster has logic to prevent such a URL from stalling the system. It does this by taking the md5 hash of the URL looking for another page in the scan that has the same hash.
This does not appear to be working correctly in some circumstances. I believe this is because of URI truncation in the database.
The script looks first for the full url
, then gets inserted as the truncated url
. because the truncated url has a different md5 hash than the full URL, it will result in duplicate pages being scanned.
There is currently no limit to the number of links that will be checked by the link checker metric. This is perhaps the main source of slow scans.
Currently, there are on average 80.73 links/page. To be generous, I propose implementing a limit of 150 links per page.
SELECT AVG (total) FROM (SELECT count(*) as total FROM `scanned_page_links` GROUP BY scanned_page_id) as query
There is no login link or button in the navigation/home.
I don't particularly like auto login for services, so I would prefer to have to click a button than to have the system attempt a gateway auth.
The list for site pages can easily become unwieldy for large (segmented) sites. Implementing a tree view would help better locate pages quicker.
There is a bug in CURL versions < 7.20, which cases requests to a url with a fragment (index.php#fragment) to return a 400 HTTP response. Because redhat 6 and other distros only support 7.19, I am including a workaround
This will be done by assigning the 'admin' role instead.
Some HEAD requests return a false positive when checking links. For example, they will return a 404, 500, etc while the same GET request will return a 200.
If a page is a hot spot for a metric and that page is then fixed/changed by a single page scan, the "Current Report" will still show the page as a "hot spot" even though the GPA and pages all reflect "A+" status.
This <link>
is used to tell robot agents the permalink for a page. This URL could be used to reduce the number of duplicate pages that appear in a scan. For example, a product page that has a URL for every category it's in.
Or do you want to be able to queue something already queued?
When a site is upgraded to https, the scan fails. It should detect the change, update the base url and restart the scan.
http://webaudit.unl.edu/sites/774/pages/101/
It'd be helpful to be able to jump to a specific metric section in the report with named anchors.
The href
attribute of an anchor element is allowed (by spec http://www.w3.org/TR/html5/links.html#attr-hyperlink-href) to be padded by spaces. So the href
should be trimmed before sent off to a metric for further work.
I often get the question "This page shouldn't be linked to, how did your tool find it?".
Take http://www.unl.edu for example. On campus it redirects to http://news.unl.edu/newsrooms/unltoday/
Currently SiteMaster will follow the redirect, and scan, but it still thinks that the baseurl is www.unl.edu/ so any relative links that it finds are converted into absolute links incorrectly. That means there are a lot of 404s.
Perhaps it would be better to not scan baseurls that redirect...
This project was created before puppeteer was released. Thus we used the best headless browser at the time, nightmarejs. Now that Google Chrome has an official headless browser, we should use that.
URIs which are case sensitive are converted to lowercase when presented in the list of pages found on site.
If a scan is queued the default date should not be shown and the GPA/info information should also be hidden.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.