Not very often, but sometimes, the term “scholarly” may also be used to describe conferences and other activities in the field of humanities and social sciences. It will not be grammatically and comprehensively correct to say “scholarly conference in chemistry”, but a “scholarly conference in history” is a correct way to describe the event. It is always appropriate to use "academic conference" instead of "scholarly conference" or "scientific conference".