DOE Proposals: Who reviews them

[born_a_prof]

I was wondering if anyone here has some info on who ends up reviewing DOE proposals (specifically, those from BES) ? Is it mostly the DOE lab scientists ? Or do they go out to academics similar to NSF ad-hoc proposals ?

[fizzycist]

I've reviewed a few times for BES as a "mail in" reviewer. But I noticed one case where the funding decision went opposite to my review. So can't say how the actual decision making gets done, the process is relatively opaque.

[Beebee]

I am finally in discussions with a program manager, and it has been very granular... Yes, other researchers do the mail in reviews. But unlike the NSF, there is no panel; the program manager has broad control over who they pick to review (it's easy to make that strategic, if you know what I mean), and the decision making is also opaque. The advice I get is to work closely with the program manager to ask their opinion - not nearly as necessary in most NSF programs in my experience, which run a lot more transparently.

[doc700]

I've reviewed BES proposals.  I've mostly been asked to review proposals from a PO who has also funded me although I have also been asked in a program slightly less close to my expertise.  I've reviewed both Early Career and regular proposals with a few PIs. 

I was wondering if anyone here has some info on who ends up reviewing DOE proposals (specifically, those from BES) ? Is it mostly the DOE lab scientists ? Or do they go out to academics similar to NSF ad-hoc proposals ?

[born_a_prof]

I am finally in discussions with a program manager, and it has been very granular... Yes, other researchers do the mail in reviews. But unlike the NSF, there is no panel; the program manager has broad control over who they pick to review (it's easy to make that strategic, if you know what I mean), and the decision making is also opaque. The advice I get is to work closely with the program manager to ask their opinion - not nearly as necessary in most NSF programs in my experience, which run a lot more transparently.

When you say ask PM for their opinion, do you mean about the proposal topic or the reviewers ? I have done the former, and went through the pre-proposal stage. A proposal was encouraged and so I am writing one. Is there anything else I can do ?

[Hibush]

I am finally in discussions with a program manager, and it has been very granular... Yes, other researchers do the mail in reviews. But unlike the NSF, there is no panel; the program manager has broad control over who they pick to review (it's easy to make that strategic, if you know what I mean), and the decision making is also opaque. The advice I get is to work closely with the program manager to ask their opinion - not nearly as necessary in most NSF programs in my experience, which run a lot more transparently.

When you say ask PM for their opinion, do you mean about the proposal topic or the reviewers ? I have done the former, and went through the pre-proposal stage. A proposal was encouraged and so I am writing one. Is there anything else I can do ?

My experience is not DOE, but may be applicable generally.

As far as reviewers, it could be reasonable to ask how much knowledge of the specific topic it is safe to assume, so that you can provide the  right amount of detail. I compete for funding from a program with big teams. As a result, our conflict-of-interest lists include just about everyone who has ever been funded, or hopes to get funded, by this  panel. Therefore, the reviewers are people who don't know the subject all that well. That's good to know!

If the panel manager has a lot of influence over the decision, you could inquire about their their overall program priorities, and thinking about which deliverables from the project would be particularly valuable. They may have opinions. If you are asking about their programs priorities, they can tell you a lot--if they want to. You are implicitly offering to help their program be successful, and presumably can read enough between the lines to know what to highlight in your proposal without asking them to get into inappropriate territory.

[polly_mer]

Hibush gives good advice.  I haven't been involved with BES recently, but definitely be aligned with what any DOE program has as current priorities. 

NSF priorities are more like suggestions because the overall goals are to support good science and help educate novices. 

DOE priorities are rules because the goal is to make progress on specific problems of interest.

[Beebee]

I am finally in discussions with a program manager, and it has been very granular... Yes, other researchers do the mail in reviews. But unlike the NSF, there is no panel; the program manager has broad control over who they pick to review (it's easy to make that strategic, if you know what I mean), and the decision making is also opaque. The advice I get is to work closely with the program manager to ask their opinion - not nearly as necessary in most NSF programs in my experience, which run a lot more transparently.

When you say ask PM for their opinion, do you mean about the proposal topic or the reviewers ? I have done the former, and went through the pre-proposal stage. A proposal was encouraged and so I am writing one. Is there anything else I can do ?

The first two I contacted said relatively little - the first gave me broad thoughts etc., the second gave an encourage to the preproposal but not much more. The latest one has been setting up meetings discussing the specific hypotheses in my pre-proposal! So yeah; seems to be a range. I am hoping the fact that the latter is happening is a good thing, it means he wants to fund it and is trying to make it so that the specific reviewers he will pick will be likely to give good reviews. I have definitely seen how targeted reviewer selection can lead to tricky reviews (in the DOE Early Career program, and in a specific program at NSF that uses only mail reviews)... Some included literally personal attacks and comments. Some ideas in rejected proposals emerged in the future work/proposals of senior researchers in the field, funded by the same program. I love the NSF, because if there is a panel and a good PM, you get a fair shake. My experience with these other programs have led to much consternation. As a correlary though, people say, once you are in, you are in?

Yeah, sorry for the cynicism...