NASA Earth and Space Science Education Product Review
FAQ

Do you have additional questions we have not addressed here? Contact IGES.

Developer FAQ
What are my username and password?
Do I need to fill out the online forms in a specific Web browser?
Can my online session time out or expire?
If I have technical problems with the Web site or a product (e.g., a CD-ROM), can I get technical assistance?
What implication(s) do final recommendations have?
What happens to these products after the review?
Do the developers see all reviewer ratings and comments?
Will the review results be made publicly available?
Where can I learn more about the Children's Online Privacy Protection Act (COPPA)?

Reviewer FAQ
What are my username and password?
Do I need to fill out the online forms in a specific Web browser?
Can my review session time out or expire?
If I have technical problems with the Web site or a product (e.g., a CD-ROM), can I get technical assistance?
Can I keep the materials that I review?
Are these materials copyrighted?  Can I share them with other teachers?
Am I expected to use these materials in my classroom as part of my review?
Can I select more than one recommendation for a product?
What if there is a criterion on the form that does not apply to the product?
What implication(s) do final recommendations have?
Is the final recommendation supposed to be an average of each of the criteria ratings?
Is there a specific rating that you are seeking for materials that are "Recommended"?
Will reviewers be notified if a product recommendation has been changed? For example, if a product was recommended for minor revisions, the changes were made, and the product is now approved?
What happens to these products after the review?
Do the developers see all reviewer ratings and comments?
Will the review results be made publicly available?
Where can I learn more about the Children's Online Privacy Protection Act (COPPA)?
What if I am a faculty member at a university that has a product in the review -- should I still review the product?
If I am a science reviewer and would like to give input on educational qualities of the materials -- can I fill out the "Educator" form?
Can other people see the products I am reviewing, or should I review them in private?

DEVELOPER FAQ

What are my username and password?
Your username is your e-mail address, and your password was assigned/e-mailed to you. If you forgot your password, please Contact IGES.

Back to Top

Do I need to fill out the online forms in a specific Web browser?
No. Firefox is best browser choice, but the online forms should function in all Web browsers.

Back to Top

Can my online session time out or expire?
Yes. If your review form is open and inactive for too long, it can expire. Please be sure to ‘Save as Draft’ often, so you do not lose any information.

Back to Top

If I have technical problems with the Web site or a product (e.g., a CD-ROM), can I get technical assistance?

Yes. Please Contact IGES with specific details on the technical problem you are having and what you were doing when it happened.

Back to Top

What implication(s) do final recommendations have?

Each product reviewer gives the product an overall rating, which we use to determine if a panel telecon is required (if everyone recommends a product, a panel telecon is not needed). The final recommendation that results from the panel telecon will determine what next steps the product developers will need to take. To see a list of all possible recommendations and their specific implications, click here or download them as a PDF.

Back to Top

What happens to these products after the review?

IGES will meet with a panel of NASA Earth & Space Science Education representatives to present the results of the review. They will consider the products and the panel recommendations in light of the overall SMD Earth & space science education program, the suite of materials available, NASA science education program goals and objectives, NASA education programs operating principles, budget (for printing/production), content (e.g., are there other available NASA materials that cover these topics equally well or better?), etc. In some cases they may decide to make changes to the final review results for specific products.

Back to Top

Do the developers see all reviewer ratings and comments?
Developers will receive a final review summary that includes the panel discussion summary and final recommendations (reviewer identifications will be removed from all of the information product developers receive.) In some cases individual reviews will include very detailed comments (e.g., of specific edits/corrections needed or suggestions for improving) that would be useful for the developer to have.  In these cases we also provide that information as part of the review summary (but without the reviewer's name) that goes to product developers.

We will provide NASA with a list of all the reviewers who participate in the review process, but will not identify specific comments/review forms by reviewer name. We believe the independent, anonymous nature of this peer review is important for ensuring the integrity of the review process.

Back to Top

Will the review results be made publicly available?
No. The specific comments and ratings given to materials will be made available to the product developers only. The only thing made public is whether or not a product passes the review process.

Back to Top

Where can I learn more about the Children's Online Privacy Protection Act (COPPA)?

This act states two requirements for conformance by WWW sites for children under 13: state the privacy policy; and require parental permission before collecting information from children 13 and younger. This is all you need to know for this review. If you are not sure whether a site fulfills these requirements – check "Can't tell." We do not want reviewers to spend a lot of time determining this.

Back to Top

REVIEWER FAQ

What are my username and password?
Your username is your e-mail address, and your password was assigned/e-mailed to you. If you forgot your password, please Contact IGES.

Back to Top

Do I need to fill out the online forms in a specific Web browser?
No. Firefox is the best browser choice, but the online forms should function in all Web browsers.

Back to Top

Can my review session time out or expire?
Yes. If your review form is open and left inactive, it expire in just over 30 minutes. Please be sure to "Save as Draft" often, so you do not lose any information. If the computer 'goes to sleep' it will also cause you to lose your work.

Back to Top

If I have technical problems with the Web site or a product (e.g., a CD-ROM), can I get technical assistance?
Yes. Please Contact IGES with specific details on the technical problem you are having and what you were doing when it happened.

Back to Top

Can I keep the materials that I review?
Yes, if you review a physical product you are welcome to keep all materials you review (this is one of the benefits of participating in the review).

Back to Top

Are these materials copyrighted?  Can I share them with other teachers?

If a product is copyrighted, it will typically be noted in the material. In most cases the materials can be copied and distributed for educational purposes. Most of the materials being reviewed are also freely available to download on the Web. If you are not sure about whether a specific product is copyrighted, Contact IGES.

Back to Top

Am I expected to use these materials in my classroom as part of my review?

No. In past reviews, we have had reviewers try out activities with their class, have a student read or use a product, and provide this feedback in their review. If you wish to do this, it will be helpful for the review process, but it is not required.

Back to Top

Can I select more than one recommendation for a product?

Yes. In general, one recommendation is preferred, but there may be occasions when more than one recommendation is appropriate. For example, if you think a product needs minor revisions, and then would be appropriate for distribution through teacher workshops; or if you believe an item is appropriate for both broad distribution and through teacher workshops. If you do this, select your first recommendation on the online form and add your other recommendations in the summary comments section.

Back to Top

What if there is a criterion on the form that does not apply to the product?
If a criterion does not apply, select “N/A” (Not Applicable).

Back to Top

What implication(s) do final recommendations have?

Each product reviewer gives the product an overall rating, which we use to determine if a panel telecon is required (if everyone recommends a product, a panel telecon is not needed). The final recommendation that results from the panel telecon will determine what next steps the product developers will need to take. To see a list of all possible recommendations and their specific implications, click here or download them as a PDF.

Back to Top

Is the final recommendation supposed to be an average of each of the criteria ratings?
Use the Review Summary page as your guide. While all of the criteria have equal value you should be able to develop an overview rating of the quality of the product. For example, if the majority of your ratings for individual criteria are "very good, " it is likely the product would be rated at that value as well. If the ratings for criteria vary, please use your professional judgment as to the best overall rating for the product. Remember there are typically 6 other reviewers looking at a product, which will balance the final recommendation (determined after the panel teleconference).

Back to Top

Is there a specific rating that you are seeking for materials that are "Recommended"?
We do not dictate what rating a product should have in order to be recommended. For example, in some cases products receive high ratings, but need minor revisions before NASA broadly distributes the product. Recommending a product that does not receive consistently high ratings (Outstanding, Very Good) would need to be justified by the panel.

Back to Top

Will reviewers be notified if a product recommendation has been changed? For example, if a product was recommended for minor revisions, the changes were made, and the product is now approved?

In general we do not contact the review panel after the review. We may contact you if there are specific questions or clarifications needed regarding recommendations, or if the developer revises the product and there are questions regarding whether they have adequately addressed the original panel concerns and recommendations. Once a product passed the NASA SMD Review process, it is listed in DLESE (Digital Library for Earth Science Education) catalog at: http://www.dlese.org/dds/histogram.do?group=subject&key=eserev  and at the SSERD (Space Science Education Resource Directory) at:

http://teachspacescience.org/cgi-bin/ssrtop.plex.

Back to Top

What happens to these products after the review?
IGES will meet with a panel of NASA Earth & Space Science Education representatives to present the results of the review. They will consider the products and the panel recommendations in light of the overall SMD Earth & space science education program, the suite of materials available, NASA science education program goals and objectives, NASA education programs operating principles, budget (for printing/production), content (e.g., are there other available NASA materials that cover these topics equally well or better?), etc. In some cases they may decide to make changes to the final review results for specific products.

Back to Top

Do the developers see all reviewer ratings and comments?
Yes. All of the review information will be provided to product developers. This includes the individual review forms you complete and submit, the panel discussion summary, and final recommendations (reviewer identifications will be removed from all of the information product developers receive.) We will provide NASA with a list of all the reviewers who participate in the review process, but will not identify specific comments/review forms by reviewer name. We believe the independent, anonymous nature of this peer review is important for ensuring the integrity of the review process.

Back to Top

Will the review results be made publicly available?
No. The specific comments and ratings given to materials will be made available to the product developers only. The only thing made public is whether or not a product passes the review process.

Back to Top

Where can I learn more about the Children's Online Privacy Protection Act (COPPA)?
This act states two requirements for conformance by WWW sites for children under 13: state the privacy policy; and require parental permission before collecting information from children 13 and younger. This is all you need to know for this review. If you are not sure whether a site fulfills these requirements – check "Can't tell." We do not want reviewers to spend a lot of time determining this.

Back to Top

What if I am a faculty member at a university that has a product in the review -- should I still review the product?
If you did not participate in the development of a product, do not work in the department that developed the product, and feel that you do not have a conflict of interest, this may be acceptable. This is especially true in very large organizations (e.g., a NASA Center) where you may have had no contact with the developer. If you have any questions about potential conflicts of interest please Contact IGES.

Back to Top

If I am a science reviewer and would like to give input on educational qualities of the materials -- can I fill out the "Educator" form?
No. You are assigned a specific form online. You may include comments on other qualities of the materials not addressed by the criteria you are provided in the Summary Comments.

Back to Top

Can other people see the products I am reviewing, or should I review them in private?
In general, there are no restrictions on showing the products to others. Overall, please use good professional judgment when including comments, both positive and negative, in your review forms. An exception, however, would be cases where developers have provided passwords for reviewers to access materials, e.g., on the Web. We ask that you respect their request to keep Web site passwords confidential.

Back to Top

Bottom Image